-- Logs begin at Wed 2022-06-15 09:21:14 UTC, end at Wed 2022-06-15 11:14:50 UTC. -- Jun 15 10:12:45.593926 dv-cinder-845806-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:12:45.602729 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:12:45 2022] *** Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: nodename: dv-cinder-845806-2-iscsi Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: machine: x86_64 Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: clock source: unix Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: pcre jit disabled Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: detected number of CPU cores: 4 Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: current working directory: / Jun 15 10:12:45.604755 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: your processes number limit is 47680 Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: your memory page size is 4096 bytes Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: detected max file descriptor number: 2048 Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: lock engine: pthread robust mutexes Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: thunder lock: enabled Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:12:45.605477 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:12:45.648891 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: Python main interpreter initialized at 0x559bf76529c0 Jun 15 10:12:45.648891 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: python threads support enabled Jun 15 10:12:45.648891 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: your server socket listen backlog is limited to 100 connections Jun 15 10:12:45.648891 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:12:45.649244 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:12:45.649338 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: *** Operational MODE: preforking *** Jun 15 10:12:45.649606 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:12:45.649606 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: spawned uWSGI master process (pid: 103726) Jun 15 10:12:45.649810 dv-cinder-845806-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:12:45.651389 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: spawned uWSGI worker 1 (pid: 103727, cores: 1) Jun 15 10:12:45.651389 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: spawned uWSGI worker 2 (pid: 103728, cores: 1) Jun 15 10:12:45.651389 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:12:46.314873 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:12:46.327430 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:12:47.492178 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:47.492178 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: from cryptography.utils import int_from_bytes Jun 15 10:12:47.492793 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:47.492793 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: from cryptography.utils import int_from_bytes Jun 15 10:12:47.496937 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:47.496937 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: from cryptography.utils import int_from_bytes Jun 15 10:12:47.497378 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:12:47.497378 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: from cryptography.utils import int_from_bytes Jun 15 10:12:50.078146 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:12:50.078717 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:12:50.078914 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:12:50.079279 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:12:50.079535 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:12:50.079620 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:12:50.079994 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:12:50.080082 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.080236 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.080385 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:12:50.080555 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.080747 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:12:50.080891 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.081079 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:12:50.081215 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.081401 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.081525 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.081724 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.081845 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082041 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082167 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082498 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082680 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082770 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.082987 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083077 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083305 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083389 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-2-iscsi {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083623 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083713 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.083945 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084028 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084203 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084288 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084516 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084608 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084835 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-2-iscsi {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.084926 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085180 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085276 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085579 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085790 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.085987 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.086206 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.086428 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.086590 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.086739 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.086850 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087040 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087157 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087378 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087539 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087695 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.087871 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.088610 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089026 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089110 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089193 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089328 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089422 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089506 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089616 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089790 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.089923 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090195 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-2-iscsi {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090288 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090516 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090831 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.090927 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091136 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091218 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091526 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-2-iscsi {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091622 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091839 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.091929 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092148 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092247 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092457 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092552 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092781 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.092907 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.093110 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.093374 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.093458 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.093686 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.093769 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094005 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094099 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094326 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094411 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094631 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094722 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.094949 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095040 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095263 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095369 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095574 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095657 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095881 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.095974 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096178 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096271 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096426 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096514 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096736 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.096828 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097080 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097168 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097388 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097572 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097672 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097751 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.097922 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098007 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098189 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098281 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098511 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098596 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098833 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.098925 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099142 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099235 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099390 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099472 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099637 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099744 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.099952 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100037 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100268 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100353 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100572 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100655 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100877 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.100975 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101216 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101349 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101604 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101823 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.101910 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102124 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102208 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102429 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102572 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102732 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.102816 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.103043 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.103151 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.103352 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.103448 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.104296 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.104701 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.104782 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.104866 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.104951 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105114 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105299 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105432 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105599 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105698 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.105906 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106014 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106227 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106319 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106536 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106631 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106838 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.106931 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107156 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107256 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107474 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107574 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107779 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.107873 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108029 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108127 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108331 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108431 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108636 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108740 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.108967 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109090 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109282 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109375 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109562 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109654 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109862 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.109967 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110167 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110269 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110470 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110574 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110771 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.110859 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111087 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111186 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111377 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111468 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111675 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111769 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.111977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112083 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112276 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112364 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112582 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112692 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112878 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.112996 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113204 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113288 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113506 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113601 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113812 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.113919 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114112 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114197 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114413 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114497 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114725 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.114824 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115038 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115122 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115340 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115483 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115643 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115736 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.115947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116087 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116249 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116334 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116551 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116642 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116855 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.116937 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117182 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117281 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117486 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117580 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117787 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.117877 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118088 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118171 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118393 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118481 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118699 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.118782 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.119002 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.119083 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.119384 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.119862 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.119948 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120037 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120123 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120205 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120289 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120371 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120503 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120609 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120805 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.120911 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121130 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121246 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121430 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121548 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121751 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.121898 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122135 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122218 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122435 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122520 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122734 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.122825 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.123056 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.123159 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.123380 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.123472 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.123716 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.123812 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.124051 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.124135 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.124629 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.124733 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.124813 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.124896 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125160 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:12:50.125253 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125330 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125405 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125628 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125715 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.125967 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126052 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126281 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126363 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126609 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126694 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.126920 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127009 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127232 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127315 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127540 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127624 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127852 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.127944 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128259 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128476 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128558 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128786 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.128870 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129139 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129244 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129448 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129542 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129762 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.129855 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130175 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130391 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130474 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130705 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.130791 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131015 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131107 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131320 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131410 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131635 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131720 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.131987 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132085 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132312 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132404 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132623 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132706 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.132934 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133060 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133267 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133359 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133577 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133661 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133899 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.133992 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.134224 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.134318 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.134533 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.134623 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.134892 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135436 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135522 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135599 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135722 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135807 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.135962 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136043 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136118 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136269 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136404 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136587 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136739 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.136899 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137077 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137235 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137397 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137544 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137711 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.137855 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138065 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138337 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138425 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138615 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138702 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.138934 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139030 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139251 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139347 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139564 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139649 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139883 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.139982 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140194 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140279 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140499 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140583 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140805 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.140888 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141134 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141233 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141439 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141525 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141741 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.141825 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142051 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142154 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142352 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142437 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142662 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142751 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.142975 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143067 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143276 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143367 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143587 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143670 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143899 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.143992 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144206 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144290 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144515 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144605 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144823 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.144918 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145151 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145245 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145459 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145543 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145764 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.145861 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146068 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146151 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146383 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146475 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146694 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146780 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.146995 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147078 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147304 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147386 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147613 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147700 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.147922 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148005 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148237 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148321 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148547 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148632 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148855 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.148938 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149225 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149321 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149533 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149624 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149857 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.149949 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.150167 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.150259 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151059 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151516 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151516 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151657 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151732 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151817 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.151921 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152006 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152226 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152310 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152531 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152629 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152840 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.152932 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153172 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153261 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153479 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153565 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153785 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.153870 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154091 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154206 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154396 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154520 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154718 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.154827 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155035 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155120 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155340 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155448 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155644 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155729 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.155951 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156048 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156292 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156384 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156597 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156681 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.156913 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157040 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157242 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157327 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157544 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157628 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157846 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.157938 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158188 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158272 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158493 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158576 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158806 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.158897 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159125 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159210 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159439 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159523 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159753 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.159851 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160066 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160151 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160377 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160460 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160686 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.160777 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161014 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161107 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161323 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161418 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161635 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161721 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.161957 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162057 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162264 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162351 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162580 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162665 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162889 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.162973 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163212 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163297 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163606 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163842 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.163934 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164145 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164230 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164459 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164542 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164771 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.164856 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165117 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165286 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165430 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165515 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165744 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.165828 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.166768 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167256 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167256 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167401 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167472 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167542 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167779 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.167873 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168093 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168177 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168405 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168494 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.168817 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169058 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169145 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169377 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169517 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169693 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.169786 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170017 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170102 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170327 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170410 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170645 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170732 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.170948 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171031 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171260 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171344 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171569 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171653 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171880 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.171964 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172186 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172270 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172493 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172631 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172802 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.172995 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173145 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173359 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173456 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173670 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173761 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.173981 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174066 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174286 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174371 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174589 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174680 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174899 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.174990 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175212 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175304 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175605 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175829 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.175913 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176133 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176229 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176443 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176527 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176750 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.176835 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177075 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177161 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177375 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177457 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177682 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177778 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.177993 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178076 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178300 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178383 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178605 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178697 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178910 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.178994 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179210 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179293 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179515 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179608 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179833 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.179918 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180139 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180226 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180442 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180535 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180745 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.180836 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181068 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181156 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181391 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181739 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.181826 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182380 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182516 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182617 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182697 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182773 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.182936 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183021 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183247 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183339 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183558 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183643 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183870 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.183960 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184184 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184278 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184594 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184821 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.184912 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185154 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185247 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185464 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185547 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185770 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.185853 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186078 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186177 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186398 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186500 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186702 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.186969 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187062 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187302 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187388 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187682 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187905 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.187999 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.188218 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.188311 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.188537 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.188774 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.188867 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189127 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189217 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189445 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189551 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189785 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.189883 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190101 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190194 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190417 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190503 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190743 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.190828 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.191053 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.191137 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.191359 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.191450 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.191911 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192013 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192225 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192318 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192528 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192658 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192831 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.192915 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193155 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193256 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193458 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193541 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193761 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.193846 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194061 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194200 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194363 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194453 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194663 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194746 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.194973 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195065 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195297 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195381 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195693 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195903 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.195987 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196201 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196284 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196505 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196801 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.196930 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.197144 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.197230 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.197553 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198056 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198168 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198250 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198332 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198484 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198677 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198769 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.198980 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199065 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199305 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199388 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199615 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199701 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.199923 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200008 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200228 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200314 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200530 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200621 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200855 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.200943 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201205 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201383 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201473 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201691 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201785 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.201995 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202079 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202303 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202397 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202610 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202737 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202912 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.202996 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203220 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203306 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203528 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203613 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203836 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.203920 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204139 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204232 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204438 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204522 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204743 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.204833 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205078 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205180 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205386 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205480 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205692 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205774 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.205993 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206076 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206291 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206382 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206600 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206712 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.206904 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207035 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207208 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207292 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207517 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207610 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207818 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.207900 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208119 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208209 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208420 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208512 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208722 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.208806 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209050 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209136 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209355 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209453 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209659 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209751 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.209959 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210058 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210307 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210402 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210565 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210651 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210862 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.210944 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211160 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211265 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211465 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211559 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211763 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.211854 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212066 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212159 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212368 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212451 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212727 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.212870 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.213594 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.213695 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214155 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214249 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214249 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214406 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214517 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214603 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214818 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.214902 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215120 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215214 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215424 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215508 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215724 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.215809 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216022 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216114 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216318 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216403 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216622 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216741 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.216922 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217145 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217266 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217360 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217570 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217659 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217875 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.217981 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218216 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218302 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218606 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218858 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.218957 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219162 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219259 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219474 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219564 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219784 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.219898 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220097 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220189 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220406 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220495 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220710 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.220796 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221040 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221127 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221350 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221446 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221650 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221735 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.221961 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222053 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222266 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222364 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222575 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222666 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.222874 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223009 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223174 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223345 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223490 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223665 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223797 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.223953 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224103 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224266 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224419 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224575 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224735 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.224885 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225086 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225225 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225389 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225546 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225693 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225861 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.225999 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226176 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226302 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226492 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226607 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226809 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.226914 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227117 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227251 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227433 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227549 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227750 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.227869 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.228059 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.228151 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.228374 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.228460 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.229262 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.229412 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.229571 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.229855 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232066 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232172 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232268 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232349 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232427 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232505 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232581 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232657 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232742 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232827 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.232905 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233001 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233069 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233133 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233210 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233289 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233365 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233524 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233609 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233694 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233770 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233853 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.233936 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234020 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234104 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234183 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234266 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234500 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234586 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234815 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.234908 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235133 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235229 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235437 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235523 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235747 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.235941 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236060 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236258 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236387 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236568 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236696 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.236891 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237044 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237202 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237355 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237506 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237681 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237813 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.237988 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.238135 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.238310 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.238439 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.238730 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.238817 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239033 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239116 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239339 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239422 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239646 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239756 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.239963 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.240071 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.240369 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.240467 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.240676 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.240760 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241025 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241116 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241351 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241451 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241663 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241748 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.241981 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242092 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242296 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242390 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242623 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242722 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.242941 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243032 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243246 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243558 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243651 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243864 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.243948 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.244204 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.244475 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.244888 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.244994 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245075 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245151 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245227 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245434 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245524 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245752 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.245891 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246071 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246218 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246382 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246571 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246699 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.246843 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247111 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247210 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247428 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247524 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247736 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.247821 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248056 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248147 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248363 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248458 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248667 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.248751 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249015 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249105 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249297 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249391 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249601 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249685 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249903 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.249987 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250212 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250297 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250512 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250596 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250815 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.250906 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251120 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251205 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251425 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.251820 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252027 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252114 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252344 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252429 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252668 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252786 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.252981 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253070 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253313 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253398 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253624 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253722 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.253931 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254017 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254230 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254313 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254534 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254627 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254840 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.254924 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255142 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255227 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255441 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255539 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255741 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.255826 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256078 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256163 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256380 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256466 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256697 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.256789 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257139 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257242 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257374 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257461 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257681 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.257766 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258004 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258087 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258314 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258414 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258625 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258729 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.258930 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259015 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259235 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259351 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259542 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259636 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.259872 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260481 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260572 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260650 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260726 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260811 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.260889 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261020 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261115 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261255 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261388 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261565 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261692 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.261870 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262013 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262171 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262323 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262473 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262628 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262793 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.262936 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263096 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263241 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263418 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263585 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263726 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.263891 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.264030 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.264227 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.264332 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.264549 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.265003 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.265228 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.265541 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.265871 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.266195 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.266510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.266596 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.266827 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.266923 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267144 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267247 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267464 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267560 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267780 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.267868 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.268097 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.268407 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.268723 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269024 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269113 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269370 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269456 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269689 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.269928 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270107 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270258 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270344 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270576 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270671 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270891 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.270977 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.271205 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.271540 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.271823 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.272135 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.272447 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.272757 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.273091 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.273423 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.273744 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.273830 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274101 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274195 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274406 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274492 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274724 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.274810 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.275041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.275134 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.275376 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276448 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276552 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276640 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276725 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276813 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.276897 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.277168 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.277257 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.277656 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.277803 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.278104 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.278418 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.278733 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.279050 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.279364 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.279677 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.279988 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280115 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280301 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280432 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280618 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280759 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.280946 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281115 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281302 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281441 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281624 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281763 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.281942 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.282085 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.282258 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.282401 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.282575 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.282719 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283035 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283127 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283369 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283454 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283696 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.283781 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284024 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284110 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284361 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284447 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284678 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.284807 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285013 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285100 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285334 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285418 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285642 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285725 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.285953 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286046 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286272 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286358 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286584 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286677 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286891 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.286993 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287208 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287292 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287519 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287612 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287858 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.287964 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.288127 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.288375 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.288468 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.288689 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.288783 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289044 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289254 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289352 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289609 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289695 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.289929 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290020 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290260 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290353 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290589 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290675 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290906 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.290996 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.291869 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292340 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292340 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292501 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292579 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292662 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292740 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.292910 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293025 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293248 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293344 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293581 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293667 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293906 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.293993 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.294228 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.294312 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.294578 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.294681 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.294887 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295018 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295191 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295336 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295499 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295645 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295801 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.295977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296112 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296289 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296421 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296604 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296726 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.296911 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.297074 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.297362 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.297456 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.297678 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.297810 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.298032 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.298212 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.298332 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.298561 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299063 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299165 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299385 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299501 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299700 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.299822 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300017 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300151 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300329 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300648 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300799 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.300981 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.301133 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.301296 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.301457 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.301770 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302037 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302150 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302379 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302689 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302781 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.302991 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303090 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303293 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303379 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303684 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.303909 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304002 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304211 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304302 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304518 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304602 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304819 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.304906 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.305169 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.305478 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.305654 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.305782 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.306090 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.306518 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.306621 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.306759 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307305 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307410 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307410 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307633 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307759 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307854 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.307976 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.308189 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.308284 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.308531 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.308621 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.308869 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.309205 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.309338 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.309508 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.309820 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.309959 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310162 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310281 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310486 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310616 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310793 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.310936 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311099 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311238 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311417 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311559 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311725 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.311878 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312045 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312194 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312355 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312664 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.312847 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313030 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313165 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313347 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313479 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313792 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.313878 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314105 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314245 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314416 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314508 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314729 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.314815 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315048 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315141 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315427 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315708 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.315792 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.316014 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.316115 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.316337 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.316456 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.316887 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317008 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317235 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317547 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317653 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317847 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.317935 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318246 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318471 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318561 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318781 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.318868 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319088 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319178 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319397 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319484 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319706 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.319802 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320011 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320125 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320316 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320450 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320622 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320774 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.320936 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321110 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321296 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321437 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321616 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321763 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.321985 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.322124 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.322856 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323199 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323598 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323682 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323760 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323843 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.323921 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324130 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324231 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324439 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324526 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324756 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.324842 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325108 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325215 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325424 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325730 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.325816 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326060 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326145 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326383 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326475 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326695 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.326780 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327003 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327097 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327310 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327402 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327622 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327713 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.327929 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328015 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328301 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328401 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328546 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328640 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328864 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.328985 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329186 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329272 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329494 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329589 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329802 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.329909 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330116 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330425 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330542 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330732 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.330850 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331155 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331350 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331465 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331659 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331782 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.331967 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332089 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332273 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332394 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332577 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332696 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.332883 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333120 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333269 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333482 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333570 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333790 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.333876 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334096 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334194 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334399 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334506 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334704 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.334830 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335009 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335147 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335316 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335469 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335616 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335792 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.335920 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336112 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336222 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336425 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336510 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336762 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.336860 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337099 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337188 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337417 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337503 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337718 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.337815 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.338802 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339137 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339217 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339284 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339284 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339441 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339534 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339620 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339854 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.339940 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340172 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340259 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340502 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340608 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340833 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.340995 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341177 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341269 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341496 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341583 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341811 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.341896 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342135 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342224 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342444 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342530 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342754 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.342847 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343074 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343158 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343386 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343468 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343693 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.343785 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344004 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344089 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344314 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344405 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344625 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.344720 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345001 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345101 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345291 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345383 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345611 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345697 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.345936 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346021 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346255 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346341 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346574 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346660 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346892 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.346984 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347203 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347296 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347530 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347617 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347839 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.347923 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.348146 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.348232 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.348393 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:12:50.348480 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.348753 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.349080 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.349398 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.349710 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.350035 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.350359 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.350666 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.350989 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.351314 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.351660 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.351975 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.352312 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.352637 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.352952 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.353286 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.353628 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:12:50.354142 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103728) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:12:50.410317 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO dbcounter [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Registered counter for database nova_api Jun 15 10:12:50.415939 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO dbcounter [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Registered counter for database nova_api Jun 15 10:12:50.431469 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.435716 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_db.sqlalchemy.engines [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.438173 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writer thread running {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.442432 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writer thread running {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.496585 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.context [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12c8b336-544d-476c-a32e-34dbdfc134b1(cell1) {{(pid=103727) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:12:50.500659 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.context [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12c8b336-544d-476c-a32e-34dbdfc134b1(cell1) {{(pid=103728) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:12:50.500780 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:50.508194 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:50.508194 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:50.508417 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_concurrency.lockutils [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:50.508505 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:50.508598 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_concurrency.lockutils [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:50.508681 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO dbcounter [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Registered counter for database nova_cell0 Jun 15 10:12:50.508771 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_concurrency.lockutils [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:12:50.509386 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_concurrency.lockutils [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103728) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:12:50.511614 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO dbcounter [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Registered counter for database nova_cell1 Jun 15 10:12:50.511981 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO dbcounter [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Registered counter for database nova_cell0 Jun 15 10:12:50.515950 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO dbcounter [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Registered counter for database nova_cell1 Jun 15 10:12:50.519760 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.521461 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.525283 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_db.sqlalchemy.engines [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.526819 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writer thread running {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.527397 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_db.sqlalchemy.engines [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.533706 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writer thread running {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.538830 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writer thread running {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.673784 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writer thread running {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.683547 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO dbcounter [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Registered counter for database nova_cell0 Jun 15 10:12:50.690693 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO dbcounter [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Registered counter for database nova_cell0 Jun 15 10:12:50.691982 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.696529 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writer thread running {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:50.700052 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG oslo_db.sqlalchemy.engines [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103728) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:12:50.704320 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writer thread running {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:12:51.106999 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: WARNING keystonemiddleware.auth_token [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:51.114407 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: WARNING keystonemiddleware.auth_token [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:51.153436 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: WARNING keystonemiddleware.auth_token [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:51.162384 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: WARNING keystonemiddleware.auth_token [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:51.465081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: WARNING keystonemiddleware.auth_token [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:51.471106 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: WARNING keystonemiddleware.auth_token [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:51.476427 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bf76529c0 pid: 103727 (default app) Jun 15 10:12:51.478560 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:12:51.480335 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002367 Jun 15 10:12:51.480749 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Jun 15 10:12:51 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:12:51.512209 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: WARNING keystonemiddleware.auth_token [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:12:51.518219 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: WARNING keystonemiddleware.auth_token [None req-17f72fca-0309-496d-8988-fea4783d1379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:12:51.523544 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bf76529c0 pid: 103728 (default app) Jun 15 10:14:13.297413 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:13.299048 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Jun 15 10:14:13.299734 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:13.312206 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_api:SELECT=3 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:13.313390 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_cell0:SELECT=3 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:13.314150 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_cell1:SELECT=3 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:13.315254 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:13.816602 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-7e621e87-14ac-45e5-974f-bcf4bbae8a96 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:13.848825 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-7e621e87-14ac-45e5-974f-bcf4bbae8a96 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.542193 Jun 15 10:14:13.849731 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Jun 15 10:14:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:16.097392 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:16.098413 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d8a61fc0-3103-46be-9881-13dba5874975 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 15 10:14:16.098817 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:16.174702 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-eeff5a06-a8ee-419e-9862-98a79853f324 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:16.194068 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:14:16.194068 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: warnings.warn(msg) Jun 15 10:14:16.297130 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-eeff5a06-a8ee-419e-9862-98a79853f324 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.191718 Jun 15 10:14:16.298263 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:14:16.525076 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-32aadf5b-b926-4602-8ced-6ec6dca223fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:16.525076 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:14:16.525076 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:14:16.544986 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_api:SELECT=3 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:16.546572 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_cell1:SELECT=3 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:16.547354 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_cell0:SELECT=3 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:16.548329 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:14:16.685277 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-32aadf5b-b926-4602-8ced-6ec6dca223fb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.377925 Jun 15 10:14:16.687457 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Jun 15 10:14:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:18.938050 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-eeff5a06-a8ee-419e-9862-98a79853f324 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:18.939821 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-eeff5a06-a8ee-419e-9862-98a79853f324 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Jun 15 10:14:18.940476 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:19.055247 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d4c1e318-8c4d-499b-b150-e2f05b74a1f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "disk": 5}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:19.072934 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:14:19.072934 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:14:19.229968 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d4c1e318-8c4d-499b-b150-e2f05b74a1f0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.281638 Jun 15 10:14:19.230520 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:14:19.243354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-6291740e-1b2a-4997-af54-03938b6e1d81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:19.244821 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:14:19.244821 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: warnings.warn(msg) Jun 15 10:14:19.384317 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-6291740e-1b2a-4997-af54-03938b6e1d81 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144907 Jun 15 10:14:19.385085 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Jun 15 10:14:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:21.626415 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d4c1e318-8c4d-499b-b150-e2f05b74a1f0 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:21.627435 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d4c1e318-8c4d-499b-b150-e2f05b74a1f0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 15 10:14:21.627829 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:14:21.690174 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-3892059d-d8af-4370-acd5-03c9bada66bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:21.755762 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-3892059d-d8af-4370-acd5-03c9bada66bb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121697 Jun 15 10:14:21.761091 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:14:21.768543 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-56e8c246-1233-40a8-86e7-1fe3678c66ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:21.860296 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-56e8c246-1233-40a8-86e7-1fe3678c66ab admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095248 Jun 15 10:14:21.861098 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Jun 15 10:14:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:24.109851 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-3892059d-d8af-4370-acd5-03c9bada66bb admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:24.110872 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-3892059d-d8af-4370-acd5-03c9bada66bb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 15 10:14:24.111449 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:24.173037 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-076dead0-070f-4aaf-9139-155907ac936a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:24.271579 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-076dead0-070f-4aaf-9139-155907ac936a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153573 Jun 15 10:14:24.272280 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:14:24.285304 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-279e08d9-9cfd-4343-94f1-3e1fa538cacc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:24.399095 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-279e08d9-9cfd-4343-94f1-3e1fa538cacc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117394 Jun 15 10:14:24.399842 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Jun 15 10:14:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:26.641162 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-076dead0-070f-4aaf-9139-155907ac936a admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:26.642833 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-076dead0-070f-4aaf-9139-155907ac936a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jun 15 10:14:26.643622 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:26.706945 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:26.794607 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144091 Jun 15 10:14:26.795704 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:14:26.807678 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-687539aa-ed39-43b1-9f3a-8fb7a11d7134 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:26.886466 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-687539aa-ed39-43b1-9f3a-8fb7a11d7134 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082463 Jun 15 10:14:26.887206 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Jun 15 10:14:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:29.127415 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:29.128987 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 15 10:14:29.131603 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:29.196808 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-0ab994b3-e0f4-432c-a7f9-6601e2d791cd admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:29.222374 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-0ab994b3-e0f4-432c-a7f9-6601e2d791cd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086048 Jun 15 10:14:29.225316 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Jun 15 10:14:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:14:31.628165 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:31.629608 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-c9f31377-15d6-4c5c-979c-f73276f930c8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jun 15 10:14:31.630088 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:31.700948 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-ffebb462-2907-4ec3-8258-fd97c3a2bebc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:31.795715 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-ffebb462-2907-4ec3-8258-fd97c3a2bebc admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.159015 Jun 15 10:14:31.796350 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:14:31.808167 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-42b06e9d-7141-4265-b1cb-56f646ffb0d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:31.908121 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-42b06e9d-7141-4265-b1cb-56f646ffb0d9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103575 Jun 15 10:14:31.908702 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Jun 15 10:14:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:34.161637 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-ffebb462-2907-4ec3-8258-fd97c3a2bebc admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:34.163338 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-ffebb462-2907-4ec3-8258-fd97c3a2bebc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002429 Jun 15 10:14:34.163969 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:34.249504 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-db6f07e7-3b3f-458b-ba67-8eb1ebb8aac8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "swap": 0, "ram": 2048}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:34.338348 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-db6f07e7-3b3f-458b-ba67-8eb1ebb8aac8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.168532 Jun 15 10:14:34.339062 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:14:34.354968 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-b221b5af-27b0-4807-a17c-79406512bbea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:34.494123 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-b221b5af-27b0-4807-a17c-79406512bbea admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145329 Jun 15 10:14:34.495115 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Jun 15 10:14:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:36.752114 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-db6f07e7-3b3f-458b-ba67-8eb1ebb8aac8 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:36.753163 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-db6f07e7-3b3f-458b-ba67-8eb1ebb8aac8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 15 10:14:36.753561 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:36.815430 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-38ebc571-8248-46f4-b4e4-70d7733c29b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:36.922485 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-38ebc571-8248-46f4-b4e4-70d7733c29b7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.162945 Jun 15 10:14:36.923573 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:14:36.935793 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-c434d36b-439a-4462-937e-ebaea54d17c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:37.055429 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-c434d36b-439a-4462-937e-ebaea54d17c8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123546 Jun 15 10:14:37.055963 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Jun 15 10:14:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:14:39.254550 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-38ebc571-8248-46f4-b4e4-70d7733c29b7 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:39.256404 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-38ebc571-8248-46f4-b4e4-70d7733c29b7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002303 Jun 15 10:14:39.269440 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:39.340312 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-fd5b8d4c-7baa-4bd8-a5b1-089e3c1c4922 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:39.430836 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-fd5b8d4c-7baa-4bd8-a5b1-089e3c1c4922 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.159291 Jun 15 10:14:39.431355 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:14:39.444270 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-b6842be8-e211-4f58-a1b0-ed29096bd759 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:39.566510 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-b6842be8-e211-4f58-a1b0-ed29096bd759 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126202 Jun 15 10:14:39.567192 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Jun 15 10:14:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:14:41.781662 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-fd5b8d4c-7baa-4bd8-a5b1-089e3c1c4922 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:14:41.782676 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-fd5b8d4c-7baa-4bd8-a5b1-089e3c1c4922 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jun 15 10:14:41.783080 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:14:41.887021 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "disk": 160, "ram": 16384, "id": "5"}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:42.699581 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.909061 Jun 15 10:14:42.700131 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Jun 15 10:14:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:14:42.712548 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-5f157fea-b0bb-4631-a256-7699982a1acf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:14:42.857893 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-5f157fea-b0bb-4631-a256-7699982a1acf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148768 Jun 15 10:14:42.858562 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Jun 15 10:14:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:15:08.083661 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:08.084669 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 15 10:15:08.085091 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:15:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:08.096749 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:08.144823 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-6621f9dc-e602-47b8-affb-e2afae0ad490 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:08.163346 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-6621f9dc-e602-47b8-affb-e2afae0ad490 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071224 Jun 15 10:15:08.163887 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Jun 15 10:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:09.155655 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.156811 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-1047dded-cf2c-4aef-922f-55c8702a44eb admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 15 10:15:09.157362 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:09.363411 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-86debc47-7e88-40e3-83cc-ec7d2885a67b admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.368852 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.wsgi [None req-86debc47-7e88-40e3-83cc-ec7d2885a67b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-86debc47-7e88-40e3-83cc-ec7d2885a67b admin admin] Request method failure captured: Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept: application/json Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept-Encoding: gzip, deflate Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Connection: keep-alive Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Content-Length: 0 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Host: 10.222.0.60 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-System-Scope: None Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: User-Agent: python-novaclient Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Auth-Token: gAAAAABiqbEtKIUmjUFlYGGFa_63Tm5tjEDPRI-NB6BCi_9GkAUjohHRkKHUOCXia_gV2KIbsuaVCvIHoOvnNl8A89PfZI9Eynt569LIsBDvcZpoCHmaWHbTXxokUBFjJuMIhk-Yhmtxwo_XelNasKo6e3vlgqprRsmg0fgZjBBECM8cvvb1hfY Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Id: None Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Name: None Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Identity-Status: Confirmed Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Is-Admin-Project: True Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Id: default Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Name: Default Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Name: admin Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Role: reader,member,admin Jun 15 10:15:09.372727 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Roles: reader,member,admin Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant: admin Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Name: admin Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User: admin Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Id: default Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Name: Default Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Name: admin Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: method: > Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: exception: Flavor 42 could not be found. Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: action_args: {'id': '42'} Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:09.374409 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:09.375440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.376796 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-86debc47-7e88-40e3-83cc-ec7d2885a67b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:09.378128 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-86debc47-7e88-40e3-83cc-ec7d2885a67b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064684 Jun 15 10:15:09.378128 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:09.383930 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-d6b924a2-0217-4758-8035-3fd8761b2433 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.386782 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:15:09.406224 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-d6b924a2-0217-4758-8035-3fd8761b2433 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025834 Jun 15 10:15:09.406782 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:09.416600 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-41ea44d9-fe40-4764-b8d2-34a7a65ace9f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.438443 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-41ea44d9-fe40-4764-b8d2-34a7a65ace9f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025396 Jun 15 10:15:09.438975 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:09.448456 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-19528e1f-0775-4809-8ed3-b80b95f2c2df admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:09.455660 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.wsgi [None req-19528e1f-0775-4809-8ed3-b80b95f2c2df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-19528e1f-0775-4809-8ed3-b80b95f2c2df admin admin] Request method failure captured: Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept: application/json Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept-Encoding: gzip, deflate Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Connection: keep-alive Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Content-Length: 0 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Host: 10.222.0.60 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-System-Scope: None Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: User-Agent: python-novaclient Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Auth-Token: gAAAAABiqbEtKIUmjUFlYGGFa_63Tm5tjEDPRI-NB6BCi_9GkAUjohHRkKHUOCXia_gV2KIbsuaVCvIHoOvnNl8A89PfZI9Eynt569LIsBDvcZpoCHmaWHbTXxokUBFjJuMIhk-Yhmtxwo_XelNasKo6e3vlgqprRsmg0fgZjBBECM8cvvb1hfY Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Id: None Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Name: None Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Identity-Status: Confirmed Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Is-Admin-Project: True Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Id: default Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Name: Default Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Name: admin Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Role: reader,member,admin Jun 15 10:15:09.458890 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Roles: reader,member,admin Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant: admin Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Name: admin Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User: admin Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Id: default Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Name: Default Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Name: admin Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: method: > Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: exception: Flavor 42 could not be found. Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: action_args: {'id': '42'} Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:09.471977 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:09.473081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-19528e1f-0775-4809-8ed3-b80b95f2c2df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:09.474106 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-19528e1f-0775-4809-8ed3-b80b95f2c2df admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015361 Jun 15 10:15:09.474106 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Jun 15 10:15:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:10.344998 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-41ea44d9-fe40-4764-b8d2-34a7a65ace9f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.346317 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-41ea44d9-fe40-4764-b8d2-34a7a65ace9f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 15 10:15:10.346718 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:10.542024 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-54c9ecc7-896d-40cb-ae47-e3649bcd3cd7 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.548167 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.wsgi [None req-54c9ecc7-896d-40cb-ae47-e3649bcd3cd7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-54c9ecc7-896d-40cb-ae47-e3649bcd3cd7 admin admin] Request method failure captured: Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept: application/json Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept-Encoding: gzip, deflate Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Connection: keep-alive Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Content-Length: 0 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Host: 10.222.0.60 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-System-Scope: None Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: User-Agent: python-novaclient Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Auth-Token: gAAAAABiqbEuO6x0a1awH-zFDPlMg8TX6B-tgh6LLXNVrJOA8NXqRcdMNDLUkUPBgRehJ1ljtPyHr5oG64JuJpB3ydsAWGnmfDlM4crWrmFyruvnL5Lsc3zMeU9NJ4JHPT3IBIXWCFRFlh0hCTpAbyTRN40haTKtkUwdQIxgIGsIuZLnngU0ZEI Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Id: None Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Name: None Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Identity-Status: Confirmed Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Is-Admin-Project: True Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Id: default Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Name: Default Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Name: admin Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Role: reader,member,admin Jun 15 10:15:10.549703 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Roles: reader,member,admin Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant: admin Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Name: admin Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User: admin Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Id: default Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Name: Default Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Name: admin Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: method: > Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: exception: Flavor 84 could not be found. Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: action_args: {'id': '84'} Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:10.551298 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:10.552330 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-54c9ecc7-896d-40cb-ae47-e3649bcd3cd7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:10.554627 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-54c9ecc7-896d-40cb-ae47-e3649bcd3cd7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063205 Jun 15 10:15:10.554627 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:10.561353 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-5c9d1196-4ad4-4e58-ba9f-f2bf303011da admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.577527 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-5c9d1196-4ad4-4e58-ba9f-f2bf303011da admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019881 Jun 15 10:15:10.578067 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:10.588203 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-364b1ddd-12be-47c5-94f5-564a859bc0e0 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.602758 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-364b1ddd-12be-47c5-94f5-564a859bc0e0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018480 Jun 15 10:15:10.607268 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:10.615720 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-d9ef8969-aeb8-4d5a-aa70-b3590a5875b5 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:10.621121 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.wsgi [None req-d9ef8969-aeb8-4d5a-aa70-b3590a5875b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-d9ef8969-aeb8-4d5a-aa70-b3590a5875b5 admin admin] Request method failure captured: Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept: application/json Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept-Encoding: gzip, deflate Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Connection: keep-alive Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Content-Length: 0 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Host: 10.222.0.60 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-System-Scope: None Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: User-Agent: python-novaclient Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Auth-Token: gAAAAABiqbEuO6x0a1awH-zFDPlMg8TX6B-tgh6LLXNVrJOA8NXqRcdMNDLUkUPBgRehJ1ljtPyHr5oG64JuJpB3ydsAWGnmfDlM4crWrmFyruvnL5Lsc3zMeU9NJ4JHPT3IBIXWCFRFlh0hCTpAbyTRN40haTKtkUwdQIxgIGsIuZLnngU0ZEI Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Id: None Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Name: None Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Identity-Status: Confirmed Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Is-Admin-Project: True Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Id: default Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Name: Default Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Name: admin Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Role: reader,member,admin Jun 15 10:15:10.622844 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Roles: reader,member,admin Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant: admin Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Name: admin Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User: admin Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Id: default Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Name: Default Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Name: admin Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: method: > Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: exception: Flavor 84 could not be found. Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: action_args: {'id': '84'} Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:10.624354 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:10.625158 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:10.626233 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-d9ef8969-aeb8-4d5a-aa70-b3590a5875b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:10.627443 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-d9ef8969-aeb8-4d5a-aa70-b3590a5875b5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012352 Jun 15 10:15:10.627443 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Jun 15 10:15:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:11.500401 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-364b1ddd-12be-47c5-94f5-564a859bc0e0 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.501464 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-364b1ddd-12be-47c5-94f5-564a859bc0e0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 15 10:15:11.501859 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:11.697851 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-64b3020d-9468-4216-b946-79b22b945fcb admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.704460 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.wsgi [None req-64b3020d-9468-4216-b946-79b22b945fcb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-64b3020d-9468-4216-b946-79b22b945fcb admin admin] Request method failure captured: Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept: application/json Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Accept-Encoding: gzip, deflate Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Connection: keep-alive Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Content-Length: 0 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Host: 10.222.0.60 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Openstack-System-Scope: None Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: User-Agent: python-novaclient Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Auth-Token: gAAAAABiqbEvo7LExzTVhrQeb8Od_99z0gSxqkDWOFUKts9R98_TmNPnA-y3ubWrHRQBQwYInbHhDDc0D0ioIH58ogX2hyASwen6ixnx5EWV8g_cf7MIujRciBf0WK3qH7KDuiCtEx2mL0_GpEibib82_HL0cZCJ5E8bb05iA_PwQKl20zgfAB0 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Id: None Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Domain-Name: None Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Identity-Status: Confirmed Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Is-Admin-Project: True Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Id: default Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Domain-Name: Default Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Project-Name: admin Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Role: reader,member,admin Jun 15 10:15:11.705983 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Roles: reader,member,admin Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant: admin Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-Tenant-Name: admin Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User: admin Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Id: default Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Domain-Name: Default Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: X-User-Name: admin Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: method: > Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: exception: Flavor 451 could not be found. Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: action_args: {'id': '451'} Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:11.707483 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:11.708479 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.709947 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-64b3020d-9468-4216-b946-79b22b945fcb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:11.711142 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-64b3020d-9468-4216-b946-79b22b945fcb admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063199 Jun 15 10:15:11.711142 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:11.717398 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-b7734916-b2f4-40c6-967e-82341a2686ff admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.732316 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-b7734916-b2f4-40c6-967e-82341a2686ff admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018641 Jun 15 10:15:11.732859 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:11.742803 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.757209 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018486 Jun 15 10:15:11.757735 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:15:11.767507 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-aa404a11-c82a-4ca5-af85-a5e76cc70dc1 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:11.772926 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.wsgi [None req-aa404a11-c82a-4ca5-af85-a5e76cc70dc1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-aa404a11-c82a-4ca5-af85-a5e76cc70dc1 admin admin] Request method failure captured: Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept: application/json Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Accept-Encoding: gzip, deflate Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Connection: keep-alive Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Content-Length: 0 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Host: 10.222.0.60 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-Api-Version: compute 2.90 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Openstack-System-Scope: None Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: User-Agent: python-novaclient Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Auth-Token: gAAAAABiqbEvo7LExzTVhrQeb8Od_99z0gSxqkDWOFUKts9R98_TmNPnA-y3ubWrHRQBQwYInbHhDDc0D0ioIH58ogX2hyASwen6ixnx5EWV8g_cf7MIujRciBf0WK3qH7KDuiCtEx2mL0_GpEibib82_HL0cZCJ5E8bb05iA_PwQKl20zgfAB0 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Id: None Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Domain-Name: None Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Identity-Status: Confirmed Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Is-Admin-Project: True Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Id: default Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Domain-Name: Default Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Project-Name: admin Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Role: reader,member,admin Jun 15 10:15:11.774578 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Roles: reader,member,admin Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8232a31392e948a78496aa9a0a9a81a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8232a31392e948a78496aa9a0a9a81a0", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant: admin Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Id: 8232a31392e948a78496aa9a0a9a81a0 Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-Tenant-Name: admin Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User: admin Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Id: default Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Domain-Name: Default Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Id: ede33ec052df4b3dab11128e172fd980 Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: X-User-Name: admin Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: method: > Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: exception: Flavor 451 could not be found. Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: action_args: {'id': '451'} Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:15:11.776169 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:11.777136 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: ERROR nova.api.openstack.wsgi Jun 15 10:15:11.778303 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-aa404a11-c82a-4ca5-af85-a5e76cc70dc1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:15:11.779479 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-aa404a11-c82a-4ca5-af85-a5e76cc70dc1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011910 Jun 15 10:15:11.779479 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:15:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:15:12.655761 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:12.656770 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 15 10:15:12.657228 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:12.848561 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-786135cc-5af4-4f3c-8f68-46093e5cdf0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:12.930604 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-786135cc-5af4-4f3c-8f68-46093e5cdf0f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133938 Jun 15 10:15:12.931143 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Jun 15 10:15:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:15:13.819442 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:13.820570 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jun 15 10:15:13.821057 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:14.015520 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-be506d69-0edb-4f5a-88cb-3ae6a936eba4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:14.132887 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-be506d69-0edb-4f5a-88cb-3ae6a936eba4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.170060 Jun 15 10:15:14.133381 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Jun 15 10:15:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:15:15.009048 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:15.010050 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 15 10:15:15.010440 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:15.208674 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-5d486b18-6ec1-4d67-af69-2d7121df9111 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:15.336452 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-5d486b18-6ec1-4d67-af69-2d7121df9111 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.182154 Jun 15 10:15:15.337019 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Jun 15 10:15:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:15:16.225282 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:16.226286 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 15 10:15:16.226685 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:16.422965 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-7ed29c16-95bd-461f-8f8f-84b886d8383e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:15:16.555541 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-7ed29c16-95bd-461f-8f8f-84b886d8383e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.185524 Jun 15 10:15:16.556081 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Jun 15 10:15:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:15:17.460375 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:17.461422 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 15 10:15:17.461807 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:15:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:15:17.651371 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-bb363850-5b10-476b-82d6-9d27d67e4c60 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:15:17.671915 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-bb363850-5b10-476b-82d6-9d27d67e4c60 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072591 Jun 15 10:15:17.672382 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Jun 15 10:15:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:16:07.016394 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.017454 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-b07f191b-f5ba-4f86-bcf0-e375b9dde36f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 15 10:16:07.017854 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:16:07.028433 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:07.079176 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-6583d40c-445e-4a7b-a5b8-ac65a295fac5 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.099255 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-6583d40c-445e-4a7b-a5b8-ac65a295fac5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075477 Jun 15 10:16:07.099804 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:16:07.123887 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-9ac4dd16-da46-4825-80ea-9d065a3e13da admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.127337 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG dbcounter [-] [103728] Writing DB stats nova_api:SELECT=14 {{(pid=103728) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:16:07.132273 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-9ac4dd16-da46-4825-80ea-9d065a3e13da admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012851 Jun 15 10:16:07.132805 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:07.144462 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-a2a7cfb6-9f73-4b6e-957b-6ad187e753b0 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.153204 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-a2a7cfb6-9f73-4b6e-957b-6ad187e753b0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011208 Jun 15 10:16:07.153729 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:07.165074 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.173582 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012039 Jun 15 10:16:07.174106 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:16:07.185600 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-fd886178-09e5-429c-9b30-56c770bee364 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:16:07.193650 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-fd886178-09e5-429c-9b30-56c770bee364 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011642 Jun 15 10:16:07.194188 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Jun 15 10:16:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:19:40.912895 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:40.914607 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 15 10:19:40.915772 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:19:41.088044 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_api:SELECT=6 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:41.232282 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:41.233963 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:19:41.233963 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:19:41.235591 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:41.236043 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:41.236897 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:41.237364 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:41.287822 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-6a37be0f-f872-4145-a456-482d012e89ec admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.201343 Jun 15 10:19:41.288454 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:19:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:19:42.275816 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:42.276890 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jun 15 10:19:42.277399 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:42.480541 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:42.481789 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:19:42.481789 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:19:42.482997 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.483471 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:42.484266 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:42.484708 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:42.505878 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-1e01a826-84a1-42da-973e-0df27fb9bff6 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085390 Jun 15 10:19:42.506466 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:19:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:19:53.904468 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:53.905521 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 15 10:19:53.905918 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:54.057419 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_cell0:SELECT=4 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:54.058297 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_cell1:SELECT=4 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:54.058916 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG dbcounter [-] [103727] Writing DB stats nova_api:SELECT=8 {{(pid=103727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:19:54.111608 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:54.112725 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:19:54.112725 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:19:54.113981 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.114430 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.115250 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:54.115679 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:54.142124 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-8faae94b-ede5-4818-88f3-4a0fce2b81da admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.090223 Jun 15 10:19:54.142613 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:19:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:19:55.040427 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: DEBUG nova.api.openstack.wsgi [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] Calling method '>' {{(pid=103728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:55.041497 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: INFO nova.api.openstack.requestlog [None req-8ea630ce-8612-4778-873c-30b9c413f780 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 15 10:19:55.041922 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: [pid: 103728|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Jun 15 10:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:19:55.268264 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG nova.api.openstack.wsgi [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] Calling method '>' {{(pid=103727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:19:55.269707 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:19:55.269707 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: warnings.warn(msg) Jun 15 10:19:55.270970 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:55.271410 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:55.272185 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:19:55.273139 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: DEBUG oslo_concurrency.lockutils [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:19:55.295777 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: INFO nova.api.openstack.requestlog [None req-e1314530-2fc5-4460-bc3b-8549a60b3ed2 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086579 Jun 15 10:19:55.296344 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: [pid: 103727|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Jun 15 10:19:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:20:55.177896 dv-cinder-845806-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 10:20:55.179017 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: Wed Jun 15 10:20:55 2022 - graceful shutdown triggered... Jun 15 10:20:55.179480 dv-cinder-845806-2-iscsi devstack@n-api.service[103727]: Gracefully killing worker 1 (pid: 103727)... Jun 15 10:20:55.179824 dv-cinder-845806-2-iscsi devstack@n-api.service[103728]: Gracefully killing worker 2 (pid: 103728)... Jun 15 10:20:56.180166 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: worker 1 buried after 1 seconds Jun 15 10:20:56.180166 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: worker 2 buried after 1 seconds Jun 15 10:20:56.180166 dv-cinder-845806-2-iscsi devstack@n-api.service[103726]: goodbye to uWSGI. Jun 15 10:20:56.181850 dv-cinder-845806-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 10:20:56.182437 dv-cinder-845806-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 10:20:56.185278 dv-cinder-845806-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:20:56.199133 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:20:56.201844 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:20:56 2022] *** Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: nodename: dv-cinder-845806-2-iscsi Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: machine: x86_64 Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: clock source: unix Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: pcre jit disabled Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: detected number of CPU cores: 4 Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: current working directory: / Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: your processes number limit is 47680 Jun 15 10:20:56.202052 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: your memory page size is 4096 bytes Jun 15 10:20:56.202833 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: detected max file descriptor number: 2048 Jun 15 10:20:56.202833 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: lock engine: pthread robust mutexes Jun 15 10:20:56.202833 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: thunder lock: enabled Jun 15 10:20:56.202833 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:20:56.202833 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:20:56.253917 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: Python main interpreter initialized at 0x55b045d1e9c0 Jun 15 10:20:56.253917 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: python threads support enabled Jun 15 10:20:56.253917 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: your server socket listen backlog is limited to 100 connections Jun 15 10:20:56.253917 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:20:56.254475 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:20:56.254475 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: *** Operational MODE: preforking *** Jun 15 10:20:56.254688 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:20:56.254688 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: spawned uWSGI master process (pid: 118108) Jun 15 10:20:56.254905 dv-cinder-845806-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:20:56.256470 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: spawned uWSGI worker 1 (pid: 118120, cores: 1) Jun 15 10:20:56.257021 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: spawned uWSGI worker 2 (pid: 118121, cores: 1) Jun 15 10:20:56.257356 dv-cinder-845806-2-iscsi devstack@n-api.service[118108]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:20:56.940338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:20:56.969774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:20:58.222977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:58.222977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: from cryptography.utils import int_from_bytes Jun 15 10:20:58.223622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:58.223622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: from cryptography.utils import int_from_bytes Jun 15 10:20:58.235238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:58.235238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: from cryptography.utils import int_from_bytes Jun 15 10:20:58.235831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:58.235831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: from cryptography.utils import int_from_bytes Jun 15 10:21:00.670317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:21:00.670966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:21:00.671104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:21:00.671470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:21:00.671724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:21:00.672113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.672439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.672763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.673111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.673472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.673788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.674112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.674441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.674770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.675033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.675351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.675680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-2-iscsi {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.676003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.676314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.676629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.677026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.677311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.677825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.678140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.678648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.679857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.679857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.679857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.680103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.680330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.680642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.680994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.681301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.681640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.681941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.682348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-2-iscsi {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.682665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.682980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.683292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.683714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.684044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.684321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.684839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.685086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.685287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.689328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.690580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.691628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.693341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.693341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.693341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.693751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.694002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.694307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.694635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.694959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.695294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.695602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.695926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.696414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.696579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.696886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.697681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.697681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.697975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.698171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.698494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.698803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.699112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.699421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.699741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.700078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.700385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.700639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.700945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.701274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.701593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.701901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.702207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.702521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.702816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.703126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.703434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.703735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.704135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.704344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.704656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.704996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.705304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.705613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.705931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.706253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.706574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.706863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.707167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.707472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.707792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.708892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.709128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.709494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.709814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.710128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.710453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.710766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.711076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.711469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.711692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.712078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.712355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.712670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.713026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.713313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.713614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.713919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.714263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.714623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.714828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.715133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.715456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:21:00.715995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.716153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:21:00.716299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.716299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.716588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:21:00.716883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.717068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:21:00.717221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.717364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:21:00.717515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.717668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.717848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.718097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.718252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.718508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.718677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.718829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.719030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.719303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.719475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.719637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.719790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.719932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.720084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.720224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.720364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.720519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.720661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.720809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.720986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.721138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.721290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.721640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845806-2-iscsi {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.721802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.721956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.722099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.722262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.722417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.722568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.722717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.722859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.723001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.723142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.723295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.723444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.723444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.723720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.723720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.724000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.724185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.724355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.724597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.724838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.725021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.725188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.725340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.725492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.725634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.725776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.725923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.726093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.726303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.726447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.726589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.726728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.726728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.727147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.727311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.727461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.727461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.727747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845806-2-iscsi {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.727747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.728071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.728306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.728464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.728618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.728770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.728770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.729083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.729230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.729371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.729519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.729676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.729826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.729968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.730128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.730277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.730277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.730568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.730711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.730859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.731000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.731141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.731291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.731452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.731604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.731745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.731893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.732046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.732195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.732352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.732493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.732641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.732782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.732930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.733107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.733259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.733411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.733560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.733560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.733838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.733993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.734143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.734285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.734434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.734594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.734984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.735228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.735377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.735531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.735673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.735673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.735977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.736130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.736281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.736429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.736581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.736729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.736883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.737094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.737365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.737523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.737674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.737836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.737990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.738150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.738311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.738636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.738789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.738941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.739091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.739233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.739382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.739736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.739894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.740046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.740190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.740349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.740500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.740653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.740795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.741069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.741223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.741366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.741515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.741663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.741663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.741944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.742085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.742235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.742395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.742546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.742697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.742851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.743001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.743151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.743316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.743467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.743692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.743844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.743987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.744127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.744268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.744427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.744724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.745058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.745247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.745487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.745637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.745780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.745930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.746086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.746547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.746547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.746830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.746830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.747141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.747141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.747442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.747639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.747897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.748046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.748203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.748346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.748506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.748735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.748882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.749064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.749240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.749392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.749541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.749683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.749824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.749964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.750116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.750258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.750399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.750554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.750705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.750847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.751003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.751003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.751294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.751445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.751594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.751746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.751894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.752035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.752183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.752325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.752465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.752465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.752841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.753006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.753182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.753337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.753481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.753622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.753771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.753913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.754067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.754209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.754360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.754510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.754652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.754800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.755633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.755807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.755962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.756104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.756253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.756403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.756556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.756698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.756846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.757071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.757223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.757380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.757542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.757685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.757844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.758106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.758263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.758421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.758421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.758710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.758936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.759083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.759234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.759234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.759523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.759672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.759831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.759981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.760123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.760277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.760428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.760571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.760712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.760852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.761028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.761185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.761328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.761476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.761627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.761779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.761929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:21:00.762225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.762950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.763885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.764913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.765082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.765237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.765391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.765570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.765898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.766904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.767952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.768846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.769263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.769407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.769582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.769739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.769901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.770053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.770209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.770363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.770549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.771198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.771344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.771541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.771784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.771933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.772979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.773889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.774772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.775183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.775340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.775498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.775498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.775954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.776849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.777927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.778963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.779966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.780863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.781918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.782950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.783706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.784939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.785171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.785315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.785470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.785628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.785628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.786919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.787966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.788116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.788258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.788406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.788705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.788856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.789726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.790923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.791939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.792983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.793874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.794920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.795968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.796339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.796499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.796651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.796801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.796985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.797893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.798968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.799124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.799273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.799430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.799604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.799863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.800893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.801989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.802926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.803899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.804991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.805950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.806099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.806273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.806637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.806799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.806949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.807888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.808818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.809016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.809298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.809466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.809626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.809788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.810055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.810224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.810384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.813908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.814851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.815952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.816102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.816258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.816407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.816819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.817250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.817947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.818102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.818248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.818398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.818541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.818830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.819000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.819152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.819606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.819759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.819910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.820096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.820361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.820510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.820662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.820805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.821947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.822960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.823857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.824946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.825876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.826180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.826328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.826487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.826637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.827989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.828921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.829211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.829362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.829566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.829862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.830932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.831988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.832918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.833151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.833818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.834032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.834378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.834378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.834666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.834810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.835528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.835688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.835840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.835840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.836913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.837369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.837528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.837687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.837837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.838953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.839103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.839262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.839419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.839677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.839843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.840006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.840167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.840317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.840486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.840838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.841974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.842132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.842291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.842291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.842595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.842595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.843956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.844114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.844278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.844429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.844579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.844886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.845935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.846996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.847157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.847516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.847674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.847829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.847990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.848930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.849930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.850092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.850251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.850400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.850548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.850719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.851839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.852937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.853978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.854431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.855915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.856839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.857985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.858928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.859868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.860916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.861995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.862912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.863953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.864117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.864772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.864929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.865942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.866937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.867095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.867260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.867410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.867579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.867883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.868830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.869961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.870911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.871059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.871236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.871501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.871501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.871884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.872809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.873793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.874992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.875946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.876868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.877063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.877217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.877366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.877523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.877672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.878975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.879981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.880633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.880785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.880938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.881123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.881289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.881533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.881828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.881994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.882911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.883069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.883227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.883392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.883638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.883795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.884805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.885993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.886902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.887817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.888969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.889916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.890871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.891818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.892845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.893889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.894856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.895991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.896925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.897169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.897927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.898095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.898436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.898605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.898756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.898915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.899920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.900860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.901108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.901283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.901505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.901689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.901859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.902985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.903135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.903285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.903442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.903590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.903750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.904983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.905936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.906879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.907993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.908148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.908297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.908592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.908762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.909978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.910273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.910434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.910584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.910732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.910893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.911058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.911406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.911809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.911976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.912135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.912319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.912592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.912757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.912922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.913906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.914260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.914438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.914598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.914749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.914898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.915855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.916935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.917128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.917291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.917568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.917730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.917884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.918853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.919973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.920924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.921966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.922126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.922274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.922432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.922600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.922877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.923973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.924130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.924389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.924583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.924738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.924887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.925843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.926001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.926159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.926309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.926466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.926614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.927299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.927456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.927712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.927872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.928983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.929921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.930848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.931826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.932876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.933851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.934876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.935931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.936882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.937934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.938893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.939969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.940916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.941960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.943986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.944150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.944310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.944467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.944651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.944838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.945864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.946939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.947860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.948890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.949867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.950981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.951929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.952227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.953505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.954650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.955770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.956899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.958681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.959924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.961083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.962197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.963373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.964556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.965836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.966059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.966273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.966587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.966895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.967228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.967536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.967845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.968155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.968464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.968771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.969100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.969428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.969753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.970056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.970383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.970697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.971015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.971328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.971635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.971967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.972270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.972576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.972889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.973222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.973531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.974441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.974756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.975169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.975498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.975810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.976137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.976464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.976809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.977145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.977488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.977816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.978129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.978440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.978817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:21:00.978990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118121) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:21:00.997359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Registered counter for database nova_api Jun 15 10:21:01.017883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.025406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.042718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Registered counter for database nova_api Jun 15 10:21:01.062698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.069948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.085952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.context [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12c8b336-544d-476c-a32e-34dbdfc134b1(cell1) {{(pid=118120) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:21:01.090301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:01.091878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:01.092676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:01.094695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:01.096735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Registered counter for database nova_cell0 Jun 15 10:21:01.101430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Registered counter for database nova_cell1 Jun 15 10:21:01.108670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.110069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.117727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.118076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.130359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.context [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12c8b336-544d-476c-a32e-34dbdfc134b1(cell1) {{(pid=118121) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:21:01.134808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:01.136424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:01.137303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:01.139597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:01.141752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Registered counter for database nova_cell0 Jun 15 10:21:01.146882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Registered counter for database nova_cell1 Jun 15 10:21:01.154760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.156690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.165233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.165570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.271601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO dbcounter [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Registered counter for database nova_cell0 Jun 15 10:21:01.280560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_db.sqlalchemy.engines [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.285329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writer thread running {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.318246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO dbcounter [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Registered counter for database nova_cell0 Jun 15 10:21:01.325216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_db.sqlalchemy.engines [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118121) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:21:01.330332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writer thread running {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:21:01.615924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:21:01.623315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:21:01.659002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:21:01.666384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:21:01.971336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:21:01.977949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: WARNING keystonemiddleware.auth_token [None req-ad759814-32a4-4641-95d7-7abcc4336f4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:21:01.983262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b045d1e9c0 pid: 118120 (default app) Jun 15 10:21:02.020276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:21:02.027381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: WARNING keystonemiddleware.auth_token [None req-52920c2f-82a8-4319-8537-97a76fc5b4d0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:21:02.032865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b045d1e9c0 pid: 118121 (default app) Jun 15 10:21:44.516911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.519374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.519374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.519990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.701603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34f36e4a-951e-4d6e-ba59-ac076fbee2f3 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Action: 'create', calling method: .version_select at 0x7fc27b608790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-350423014"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:45.770745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.772409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.773377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.774410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.766883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-707920142", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "networks": [{"uuid": "b9a94368-bf8e-414f-bb60-cb17b9471ee9"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:47.327659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] validate_networks() for [('b9a94368-bf8e-414f-bb60-cb17b9471ee9', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:21:48.176121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34f36e4a-951e-4d6e-ba59-ac076fbee2f3 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.663871 Jun 15 10:21:48.178025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1154 bytes} [Wed Jun 15 10:21:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3668 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 10:21:48.191511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a71fb85-77e8-4852-b50d-8c3d9cf20a6d tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4d35e0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:48.501484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a71fb85-77e8-4852-b50d-8c3d9cf20a6d tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 200 len: 344 microversion: 2.1 time: 0.298282 Jun 15 10:21:48.501484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:21:48 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 344 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:21:49.249589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:21:49.251002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:21:49.251720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:21:49.252465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:21:49.254770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:21:49.283133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:49.283588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:49.285163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:49.289765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:49.352467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Getting quotas for project 0b8e3aa03dcf4c5a989a604548e9c4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:21:49.366784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Getting quotas for user 3f8028df66d44c478268a84167c9ff19 and project 0b8e3aa03dcf4c5a989a604548e9c4ba. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:21:49.386367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:21:49.390242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:21:49.497743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18529954-32b6-400f-bd4c-d82a068a692a tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4d3940>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:49.613545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-812f71fa-c90b-4aab-8f92-d3b823c93640 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.855074 Jun 15 10:21:49.620594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:21:49.629686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10d22505-ef3f-4da6-b0ec-58186fa16c5b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:49.630339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10d22505-ef3f-4da6-b0ec-58186fa16c5b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:49.681069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18529954-32b6-400f-bd4c-d82a068a692a tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 200 len: 344 microversion: 2.1 time: 0.187366 Jun 15 10:21:49.681679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:21:49 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:49.894599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10d22505-ef3f-4da6-b0ec-58186fa16c5b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:49.917941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10d22505-ef3f-4da6-b0ec-58186fa16c5b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1214 microversion: 2.1 time: 0.295140 Jun 15 10:21:49.929218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2/5] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:49 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:50.695488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13878735-c807-485c-9a57-2ddd72948208 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4d3d30>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:50.826576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13878735-c807-485c-9a57-2ddd72948208 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 200 len: 345 microversion: 2.1 time: 0.136389 Jun 15 10:21:50.827155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 4/6] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:21:50 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:50.843379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e425b0a2-46e7-4de8-9709-5b396a4ce44c tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Action: 'create', calling method: .version_select at 0x7fc27ac279d0>, body: {"snapshot": {"volume_id": "87d61c4e-0a23-407e-8d69-f8320087bc31", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1450982767"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:50.948164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b51c2ea0-0da2-48cd-8fff-a42e1d624c0a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:50.948849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b51c2ea0-0da2-48cd-8fff-a42e1d624c0a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:51.157136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b51c2ea0-0da2-48cd-8fff-a42e1d624c0a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:51.188644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b51c2ea0-0da2-48cd-8fff-a42e1d624c0a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1214 microversion: 2.1 time: 0.256632 Jun 15 10:21:51.189242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 5/7] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:50 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:51.655908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e425b0a2-46e7-4de8-9709-5b396a4ce44c tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.818896 Jun 15 10:21:51.662675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 3/8] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Jun 15 10:21:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:51.668464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99c2b1b9-9d64-4ad5-879d-78115d4738fc tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4a5310>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.775058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99c2b1b9-9d64-4ad5-879d-78115d4738fc tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.111497 Jun 15 10:21:51.776562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 6/9] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:21:51.787064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c84aa38-66b9-4292-961f-0850a6511343 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27a397ee0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.922760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c84aa38-66b9-4292-961f-0850a6511343 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.139220 Jun 15 10:21:51.923697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 4/10] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:51.935338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ab45126-3d31-49fe-839b-1870ca4fdece tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4b0430>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:51.998733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ab45126-3d31-49fe-839b-1870ca4fdece tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.068113 Jun 15 10:21:52.003115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 7/11] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:51 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:52.208397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-feef5718-edd4-4d93-9d36-7c93cea99c1b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:52.209479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-feef5718-edd4-4d93-9d36-7c93cea99c1b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:52.501805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-feef5718-edd4-4d93-9d36-7c93cea99c1b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:52.513156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-feef5718-edd4-4d93-9d36-7c93cea99c1b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1214 microversion: 2.1 time: 0.309300 Jun 15 10:21:52.550585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 5/12] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:52 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:53.011860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aedd8e92-af73-4e1d-a653-a3c522708cac tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4b0af0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:53.131297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aedd8e92-af73-4e1d-a653-a3c522708cac tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.124241 Jun 15 10:21:53.135847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 8/13] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:53 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:53.554904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:53.555528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:53.580708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.581908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.582708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:53.583145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:53.948545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:53.973329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c21d4c3-9e59-4df7-abc9-9bd8907f8f8d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1218 microversion: 2.1 time: 0.423294 Jun 15 10:21:53.983803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 6/14] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:53 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1218 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:54.144599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e75b4a05-fc23-418a-a5a3-37e471f17699 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4a5820>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:54.247422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e75b4a05-fc23-418a-a5a3-37e471f17699 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.107492 Jun 15 10:21:54.249514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 9/15] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:54 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:54.991554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:54.992764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:55.025742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:55.026553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:55.027568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:55.029608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:55.267336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb42a260-c80d-47a4-8d7f-883b073bbe79 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4b0ca0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:55.330077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb42a260-c80d-47a4-8d7f-883b073bbe79 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.071605 Jun 15 10:21:55.332790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 10/16] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:55 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:21:55.401785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:55.431271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e22dce25-26fb-42f7-9949-ec987514c774 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1218 microversion: 2.1 time: 0.444165 Jun 15 10:21:55.432282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 7/17] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:54 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1218 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:56.344030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ede11c51-6046-40f7-9333-090f5986816e tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b4b04c0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:56.411762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ede11c51-6046-40f7-9333-090f5986816e tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.071712 Jun 15 10:21:56.412339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 11/18] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:56 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:56.451380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:56.451988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:56.465296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.468781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.470978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:56.471469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:56.890875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:56.903163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-59989485-7b94-4347-b1c6-fb14d9274931 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1218 microversion: 2.1 time: 0.455827 Jun 15 10:21:56.914859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 8/19] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:56 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1218 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:57.428458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca0ebd2e-726f-4f29-a370-57c53303699d tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b43f1f0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:57.522752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca0ebd2e-726f-4f29-a370-57c53303699d tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.102468 Jun 15 10:21:57.528804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 12/20] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:57 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:57.928636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:57.928636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:57.944843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:57.951370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:57.953061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:57.958599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:58.471723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:58.501376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7c0609f-5e31-4b7b-98c2-4dd27d61f544 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1218 microversion: 2.1 time: 0.583354 Jun 15 10:21:58.513027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 13/21] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:57 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1218 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:58.546743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aebeb36-7520-4e73-a6da-e67f389edf3b tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b426d30>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:58.616121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0aebeb36-7520-4e73-a6da-e67f389edf3b tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 288 microversion: 2.1 time: 0.081023 Jun 15 10:21:58.616848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 14/22] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:58 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:58.628448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c42030a-ccdd-44a0-b27d-09bcd994f4f8 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b436430>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:58.832705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23ebaf73-631b-4d3e-a64b-e25111bc3b55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: .version_select at 0x7fc27a32d310>, body: {"keypair": {"name": "tempest-keypair-129715895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlFIG1Jq+dTXceTVXy+gAx9j8aalmA9q5jSSQsB0mFDjhH/rHfQ8+aSVhqvVPaWdAIj4zX3Y21QTlTu/EBSbd9OPwLLnz9eLFkkLBvBPhd5zn4Lx9lS7DcEYUWvJe86pg=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:21:58.856253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c42030a-ccdd-44a0-b27d-09bcd994f4f8 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 202 len: 0 microversion: 2.1 time: 0.229679 Jun 15 10:21:58.856253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 15/23] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Jun 15 10:21:58 2022] DELETE /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:21:58.863278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2560df67-86c2-40d1-b8de-f0d7be6eed93 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b426d30>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:58.917641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-23ebaf73-631b-4d3e-a64b-e25111bc3b55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:21:58.929409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-23ebaf73-631b-4d3e-a64b-e25111bc3b55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:21:58.935316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2560df67-86c2-40d1-b8de-f0d7be6eed93 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 200 len: 287 microversion: 2.1 time: 0.076793 Jun 15 10:21:58.939696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 16/24] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:58 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:59.153192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23ebaf73-631b-4d3e-a64b-e25111bc3b55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.262189 Jun 15 10:21:59.161453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 9/25] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:21:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:21:59.527145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:59.527764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:21:59.551029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:59.551490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:59.552278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:21:59.552712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:21:59.754718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:21:59.768237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e5f874e-4945-4549-9de3-d18244e2602d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1274 microversion: 2.1 time: 0.244733 Jun 15 10:21:59.774174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 17/26] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:21:59 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:59.948020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b2e1452-ebfc-4252-a10c-7354b301549f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27a315dc0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:21:59.973211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.049970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-2b2e1452-ebfc-4252-a10c-7354b301549f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] HTTP exception thrown: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b2e1452-ebfc-4252-a10c-7354b301549f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Request method failure captured: Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 HTTP/1.1 Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbK48s8_aYo3TyhZ_gcO0bHBOfnxe1Kg_9jA5ojjG2p4vC31xziZtAaYThg4qZ0fokBd9nXxv2LM_YAUSwPY47jhkGO9_CZZ3GILr3FQf1rzmiHIuYe5JyiNVcDH2WXyoF2NU_VCHGtgz7ipa9HfeoHU3BiFW-kqH1erx0B_Jj7jE7E Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:22:00.055080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb38b3cc097e4d9ba642740438c88dfc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4612504f393546dfbea12ffb3eed5efe Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '6e9cb2e3-ac9e-4895-9346-14747a4790f6'} Jun 15 10:22:00.056549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. (HTTP 404) (Request-ID: req-a5634dcc-76e8-443a-adbc-8afe32222522) Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.057382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:00.058423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 10:22:00.059505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:00.060576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b2e1452-ebfc-4252-a10c-7354b301549f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Returning 404 to user: Snapshot 6e9cb2e3-ac9e-4895-9346-14747a4790f6 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:22:00.071693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b2e1452-ebfc-4252-a10c-7354b301549f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6" status: 404 len: 111 microversion: 2.1 time: 0.116994 Jun 15 10:22:00.075653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 10/27] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Jun 15 10:21:59 2022] GET /compute/v2.1/os-snapshots/6e9cb2e3-ac9e-4895-9346-14747a4790f6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:22:00.081518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4453823-6ce9-4992-b41d-0e527b3e3e33 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b3c2310>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:00.428434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4453823-6ce9-4992-b41d-0e527b3e3e33 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 202 len: 0 microversion: 2.1 time: 0.350899 Jun 15 10:22:00.429726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 18/28] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:22:00 2022] DELETE /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:22:00.442971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-948e0101-ea1a-4e74-93b4-06e9c1be27aa tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc279a70040>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:00.631679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-948e0101-ea1a-4e74-93b4-06e9c1be27aa tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 200 len: 344 microversion: 2.1 time: 0.196903 Jun 15 10:22:00.632394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 11/29] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:00 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:00.794566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:00.798235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:00.846723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:00.850037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:00.852200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:00.856455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:01.182866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:01.444882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:01.458478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22ee7653-9fc2-4b1e-b489-56263e1f0b70 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1272 microversion: 2.1 time: 0.670573 Jun 15 10:22:01.459049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 19/30] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:00 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1272 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:01.654220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ad40c75-9297-4944-b220-4f85e1a97e27 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc279a70700>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:01.777852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-2ad40c75-9297-4944-b220-4f85e1a97e27 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] HTTP exception thrown: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ad40c75-9297-4944-b220-4f85e1a97e27 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Request method failure captured: Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 HTTP/1.1 Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbK48s8_aYo3TyhZ_gcO0bHBOfnxe1Kg_9jA5ojjG2p4vC31xziZtAaYThg4qZ0fokBd9nXxv2LM_YAUSwPY47jhkGO9_CZZ3GILr3FQf1rzmiHIuYe5JyiNVcDH2WXyoF2NU_VCHGtgz7ipa9HfeoHU3BiFW-kqH1erx0B_Jj7jE7E Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:22:01.796529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb38b3cc097e4d9ba642740438c88dfc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4612504f393546dfbea12ffb3eed5efe Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '87d61c4e-0a23-407e-8d69-f8320087bc31'} Jun 15 10:22:01.798949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. (HTTP 404) (Request-ID: req-93ab2f1a-13a5-4346-bd9c-681bc9c4f17a) Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.800375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:01.802314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:22:01.803877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.807365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.809914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ad40c75-9297-4944-b220-4f85e1a97e27 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Returning 404 to user: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:22:01.815314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ad40c75-9297-4944-b220-4f85e1a97e27 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 404 len: 109 microversion: 2.1 time: 0.166143 Jun 15 10:22:01.815935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 12/31] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:01 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:22:01.825996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0f913-77ca-40b6-91c8-10f416e74af0 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27b3d9d30>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:01.911525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-99d0f913-77ca-40b6-91c8-10f416e74af0 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] HTTP exception thrown: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0f913-77ca-40b6-91c8-10f416e74af0 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Request method failure captured: Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 HTTP/1.1 Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbK48s8_aYo3TyhZ_gcO0bHBOfnxe1Kg_9jA5ojjG2p4vC31xziZtAaYThg4qZ0fokBd9nXxv2LM_YAUSwPY47jhkGO9_CZZ3GILr3FQf1rzmiHIuYe5JyiNVcDH2WXyoF2NU_VCHGtgz7ipa9HfeoHU3BiFW-kqH1erx0B_Jj7jE7E Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:22:01.926595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb38b3cc097e4d9ba642740438c88dfc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4612504f393546dfbea12ffb3eed5efe Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '87d61c4e-0a23-407e-8d69-f8320087bc31'} Jun 15 10:22:01.927859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. (HTTP 404) (Request-ID: req-9c361290-413c-425a-a1d7-77bb74ee7c79) Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.928467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:22:01.929583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:22:01.930444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:22:01.931300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d0f913-77ca-40b6-91c8-10f416e74af0 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Returning 404 to user: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:22:01.932593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99d0f913-77ca-40b6-91c8-10f416e74af0 tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 404 len: 109 microversion: 2.1 time: 0.110724 Jun 15 10:22:01.937419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 20/32] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:22:01 2022] DELETE /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:22:01.948308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68d88e20-5ce7-461e-b588-4740b242752f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Calling method '.version_select at 0x7fc27a2f29d0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:02.019240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-68d88e20-5ce7-461e-b588-4740b242752f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] HTTP exception thrown: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68d88e20-5ce7-461e-b588-4740b242752f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Request method failure captured: Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 HTTP/1.1 Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbK48s8_aYo3TyhZ_gcO0bHBOfnxe1Kg_9jA5ojjG2p4vC31xziZtAaYThg4qZ0fokBd9nXxv2LM_YAUSwPY47jhkGO9_CZZ3GILr3FQf1rzmiHIuYe5JyiNVcDH2WXyoF2NU_VCHGtgz7ipa9HfeoHU3BiFW-kqH1erx0B_Jj7jE7E Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:22:02.021821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cb38b3cc097e4d9ba642740438c88dfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cb38b3cc097e4d9ba642740438c88dfc", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: cb38b3cc097e4d9ba642740438c88dfc Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2025676581 Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4612504f393546dfbea12ffb3eed5efe Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2025676581-project Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '87d61c4e-0a23-407e-8d69-f8320087bc31'} Jun 15 10:22:02.023317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. (HTTP 404) (Request-ID: req-41f875f8-0e6d-4a2e-a831-e1d8b10a0adf) Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:02.024257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:22:02.025948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:22:02.027634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. Jun 15 10:22:02.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:22:02.030581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68d88e20-5ce7-461e-b588-4740b242752f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] Returning 404 to user: Volume 87d61c4e-0a23-407e-8d69-f8320087bc31 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:22:02.031608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68d88e20-5ce7-461e-b588-4740b242752f tempest-VolumesSnapshotsTestJSON-2025676581 tempest-VolumesSnapshotsTestJSON-2025676581-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31" status: 404 len: 109 microversion: 2.1 time: 0.088946 Jun 15 10:22:02.032350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 13/33] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:01 2022] GET /compute/v2.1/os-volumes/87d61c4e-0a23-407e-8d69-f8320087bc31 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:22:02.479522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:02.480685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:02.500397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:02.505391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:02.508789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:02.512320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:03.385354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:03.405068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4b72ed3-36b4-48e1-ab1e-a2235f2f22ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1272 microversion: 2.1 time: 0.930245 Jun 15 10:22:03.417949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 21/34] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:02 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1272 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:04.435434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:04.437649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:04.487848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:04.488662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:04.497646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:04.498203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:04.745514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-193563df-2b2b-4d30-a6cb-258f51b205da tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: .version_select at 0x7fc27a39de50>, body: {"keypair": {"name": "tempest-keypair-1649871053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm5T8XYeeEpFMtwaqwmcQZ5e40WeP8lYFRUZLu6FRQ8VHvvsxE32aJzE7xNoOr7NeM0GNsXWHs2ZGzNq8NfRJoVQ5w/j6bJvJnx+pD/Dl9iGqQrFqLzYt2Kx5NOt2VoIg=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:04.794611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-193563df-2b2b-4d30-a6cb-258f51b205da tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:04.809735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-193563df-2b2b-4d30-a6cb-258f51b205da tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for user bbb69faf3ec54489a92fe87935f2f777 and project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:04.964848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-193563df-2b2b-4d30-a6cb-258f51b205da tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.734884 Jun 15 10:22:04.968580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 14/35] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Jun 15 10:22:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 736 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:05.139628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90f54453-feb7-4047-9d74-c2c5b34cf647 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: .version_select at 0x7fc279a704c0>, body: {"keypair": {"name": "tempest-keypair-717233124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv5kTPVdS39by0j7Iw52TBNtYfeLoIWF2+oLKyS8+8fdCIDLk8ZfYm0/ku6NUfss+I6RS54f3y2KrXjsRx7A7XuBiUI10GcUW9E7DsVM2WpdekNbk/sG2Ovg1hVSZe1yA=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:05.189288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-90f54453-feb7-4047-9d74-c2c5b34cf647 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for project a09fe8836f914998aec8ee2afcca9e16. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:05.202714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-90f54453-feb7-4047-9d74-c2c5b34cf647 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for user 9f1e192f3eab42ee9f9ed5d2789e0d1e and project a09fe8836f914998aec8ee2afcca9e16. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:05.347914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90f54453-feb7-4047-9d74-c2c5b34cf647 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.380875 Jun 15 10:22:05.355601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 15/36] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:22:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:05.967373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:05.988176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-338a423d-3b12-4870-8a16-0c6ec59e3f93 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 1.557694 Jun 15 10:22:06.001547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 22/37] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:04 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:07.006812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:07.007579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:07.018874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=20 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.029033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:07.031383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:07.034779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:07.043733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:07.774409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:07.782634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7555a094-4850-48d6-bff2-1bbc7e298afd tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.779682 Jun 15 10:22:07.783224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 16/38] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:07 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:07.833697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545653004", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:08.160690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] validate_networks() for [('c2941449-3bcb-4e99-87c3-70ca63e0e63f', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:08.804886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:08.810093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:08.821315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:08.826933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:08.829143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:08.829986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:09.645306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:09.658113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-264df36d-f43f-44ba-b4c7-1f522f716084 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.857173 Jun 15 10:22:09.659737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 17/39] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:08 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:10.851442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-50c3b80d-2641-4a28-98a9-93ad871fcd77 req-a5aed43d-38df-402b-89e4-1d3c42a5f987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36d5f4f7-99d7-4850-9719-aad011589217", "tag": "0c64e3fd-8b7d-4790-90b8-b06051a70d29"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:10.907290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-50c3b80d-2641-4a28-98a9-93ad871fcd77 req-a5aed43d-38df-402b-89e4-1d3c42a5f987 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:10.907747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-50c3b80d-2641-4a28-98a9-93ad871fcd77 req-a5aed43d-38df-402b-89e4-1d3c42a5f987 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.007088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-50c3b80d-2641-4a28-98a9-93ad871fcd77 req-a5aed43d-38df-402b-89e4-1d3c42a5f987 service nova] Creating event network-changed:0c64e3fd-8b7d-4790-90b8-b06051a70d29 for instance 36d5f4f7-99d7-4850-9719-aad011589217 on hv-cinder-84580 Jun 15 10:22:11.014747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-50c3b80d-2641-4a28-98a9-93ad871fcd77 req-a5aed43d-38df-402b-89e4-1d3c42a5f987 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:22:11.021205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.021797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.045670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.047113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.058941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.compute.rpcapi [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:22:11.059770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118121) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:22:11.109088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7626bdc6-1a6c-429f-bb12-48d78c2bcfb9 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.473664 Jun 15 10:22:11.110009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 18/40] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:11.116720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:11.117767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:11.141885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.142352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.154862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.155382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.486509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:11.519286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b6a43ac9-053d-4683-952c-72dafb8a912c tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.397443 Jun 15 10:22:11.526002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 19/41] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:11 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:11.547425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-557024770", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae25dc20-3f67-427a-9874-3a8b1d755278"}], "security_groups": [{"name": "tempest-securitygroup--1206265104"}], "key_name": "tempest-keypair-129715895", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:11.654798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:11.655266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:11.655696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:11.661654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:11.661654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:11.695863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.696297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.697335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:11.697966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:11.776582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:11.790649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for user 5090fa81be4d41bbb62da2c4f273d537 and project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:11.806479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:11.810268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:12.070863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9d25a59-efc9-493b-9cc1-056bcfc57b89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.482240 Jun 15 10:22:12.071673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 23/42] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:22:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 4484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:22:12.084094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d0311b97-5253-4e25-b376-c795069470a5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:12.084868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0311b97-5253-4e25-b376-c795069470a5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:12.239515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d0311b97-5253-4e25-b376-c795069470a5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:12.258089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d0311b97-5253-4e25-b376-c795069470a5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1221 microversion: 2.1 time: 0.179591 Jun 15 10:22:12.288786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 24/43] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:12 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:12.459704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-838583006", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:12.579607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] validate_networks() for [('c2941449-3bcb-4e99-87c3-70ca63e0e63f', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:12.630859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] validate_networks() for [('ae25dc20-3f67-427a-9874-3a8b1d755278', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:13.703649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:13.704308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:13.704910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:13.706220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:13.706805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:13.722730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.723649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.725521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.726171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.748452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:13.755524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for user 5090fa81be4d41bbb62da2c4f273d537 and project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:13.775159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:13.778493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:13.902979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:13.903452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:13.903873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:13.904283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:13.904694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:13.915591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.916080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.917117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.917558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.937119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29e89ae9-19eb-4558-827c-53220435f989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.483415 Jun 15 10:22:13.939766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:13.943513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 25/44] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:22:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:22:13.946226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:13.949451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:13.950235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:13.961245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:13.965548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:13.966882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.967466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:13.968567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:13.969130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:14.201533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:14.202663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76b1ff38-2ce5-47ab-9958-9bb1da6af998 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.671304 Jun 15 10:22:14.212808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 20/45] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:22:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:22:14.222057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11cb8c9e-7416-452d-9482-b5e18b465d76 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.277144 Jun 15 10:22:14.222770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 26/46] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:13 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:14.230460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c489432-20bf-46bd-a22f-2d66afa5183a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:14.231405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c489432-20bf-46bd-a22f-2d66afa5183a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:14.242698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed33e402-78d0-4557-9ee5-2d26bc39e1f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:14.245912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed33e402-78d0-4557-9ee5-2d26bc39e1f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:14.357447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c489432-20bf-46bd-a22f-2d66afa5183a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:14.367266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c489432-20bf-46bd-a22f-2d66afa5183a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1240 microversion: 2.1 time: 0.142629 Jun 15 10:22:14.375423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 27/47] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:14.396034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-172317949", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11cf7c9e-caa5-4e08-9e83-433282066dfb"}], "security_groups": [{"name": "tempest-securitygroup--1455343481"}], "key_name": "tempest-keypair-717233124", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:14.569773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed33e402-78d0-4557-9ee5-2d26bc39e1f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:14.579069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed33e402-78d0-4557-9ee5-2d26bc39e1f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1221 microversion: 2.1 time: 0.363599 Jun 15 10:22:14.582620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 21/48] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:14 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1221 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:14.960067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-800813271", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ed61d18-d787-4760-a0a1-dc4388f6afaf"}], "security_groups": [{"name": "tempest-securitygroup--1399740843"}], "key_name": "tempest-keypair-1649871053", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:15.136264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] validate_networks() for [('11cf7c9e-caa5-4e08-9e83-433282066dfb', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:15.294447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] validate_networks() for [('8ed61d18-d787-4760-a0a1-dc4388f6afaf', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:22:15.712579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.789925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.502656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:16.503316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:16.503617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:16.506128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:16.506768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:16.517445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:22:16.518878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:22:16.519247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:22:16.519806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:22:16.520355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:22:16.537741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=31 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.539541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.543432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.546643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.556321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.561156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.561156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.561156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.563351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.617981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:16.630135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for user bbb69faf3ec54489a92fe87935f2f777 and project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:16.653808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for project a09fe8836f914998aec8ee2afcca9e16. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:22:16.659028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:16.661445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for user 9f1e192f3eab42ee9f9ed5d2789e0d1e and project a09fe8836f914998aec8ee2afcca9e16. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:22:16.668306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:16.704462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:22:16.707538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:22:16.902378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c6febe8-dfe3-4853-85c8-79e3b06c78f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.958930 Jun 15 10:22:16.918497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 22/49] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Jun 15 10:22:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:22:16.927139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:16.927779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:16.948547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.955800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.957053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:16.957746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:16.992139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98b77ca2-5fa6-4b4f-b036-f0ee4ea5bdec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.613254 Jun 15 10:22:17.018355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 28/50] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:22:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:22:17.061733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.062920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:17.116260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.119301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.136061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.137243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.442406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.452143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de99d8e5-34e6-4e61-8d66-e16aa697b0d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1236 microversion: 2.1 time: 0.431573 Jun 15 10:22:17.453122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 29/51] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1236 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:17.482995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.487242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:17.523635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.526152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.533149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:17.534592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:17.665248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.678036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b9967b0-5d4e-4483-9c2d-5d93d693b13a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1273 microversion: 2.1 time: 0.223590 Jun 15 10:22:17.688904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 30/52] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:17.717793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9cf06c81-a4b6-4122-9276-fdc3cdb7b1e6 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc27aa78700>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.778085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.791362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c7648a0-3bba-47a0-aded-dffd425f2d9a tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.874044 Jun 15 10:22:17.802565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 23/53] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:16 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:17.821410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.826323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:17.900597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9cf06c81-a4b6-4122-9276-fdc3cdb7b1e6 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/89acd62b-54b1-4d48-8b8a-75bca05c29e6" status: 200 len: 350 microversion: 2.1 time: 0.209914 Jun 15 10:22:17.901563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 31/54] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/os-volumes/89acd62b-54b1-4d48-8b8a-75bca05c29e6 => generated 350 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:17.906964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ec376c6-0255-4f6d-ab95-a14d1fdbc2e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:17.907650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ec376c6-0255-4f6d-ab95-a14d1fdbc2e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:17.964200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.972768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.986448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:17.998147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74d6d70b-eccf-419b-bf03-7d1765f49feb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1281 microversion: 2.20 time: 0.183563 Jun 15 10:22:17.999918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 24/55] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:18.022169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ec376c6-0255-4f6d-ab95-a14d1fdbc2e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:18.031216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ec376c6-0255-4f6d-ab95-a14d1fdbc2e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1236 microversion: 2.1 time: 0.128521 Jun 15 10:22:18.061471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 32/56] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1236 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:18.472432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:18.474586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:18.494394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.495582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.496575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.498858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.696799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:18.698400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:18.717549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.718557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.720736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.721990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.722103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:18.733411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d91458a9-c11f-4325-9575-a3ac0f07ca79 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1292 microversion: 2.1 time: 0.265028 Jun 15 10:22:18.738556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 25/57] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:18.808786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:18.809821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:18.822068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.822604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:18.823677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:18.824278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.069643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.104163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1a3388f9-de78-4490-b3d7-bf30d0fca3c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1281 microversion: 2.1 time: 0.401329 Jun 15 10:22:19.117611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:18 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1281 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:19.162611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:19.163935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:19.207020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:19.207908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.209120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:19.209729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.516126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.532558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.541321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.542725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ccb80ccb-a7c9-4818-b734-a2a2a4bb7842 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1285 microversion: 2.20 time: 0.420973 Jun 15 10:22:19.544402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 34/59] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1285 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:19.557752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:19.558887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:19.573837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:19.574638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.575717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:19.576407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:19.957354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:19.975035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ca6331a-1bfc-4029-bc0d-fc47bc07f40f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 1.169014 Jun 15 10:22:19.978234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 26/60] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:18 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:19.997743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:20.012050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:20.012050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.012050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.013178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.013681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.061477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.084226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8cc239f0-e450-418e-bc07-e6c0a81f56c7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1240 microversion: 2.1 time: 0.538437 Jun 15 10:22:20.097283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 35/61] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1240 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:20.121058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:20.122103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:20.149100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.151903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.154070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.156144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.357401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.369315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62e2650b-fee5-4892-8ab6-d9ab11eaa517 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1279 microversion: 2.1 time: 0.252667 Jun 15 10:22:20.377986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 36/62] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:20 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:20.399085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.417042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be004596-5fbd-47d6-b1fb-e651a4681f52 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1310 microversion: 2.1 time: 0.432013 Jun 15 10:22:20.417824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 27/63] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1310 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:20.566899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:20.575583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:20.578201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.581576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.581766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:20.584265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:20.723156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.736798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.740312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:20.742435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d619886-2f94-4b7d-a1ec-6601ff4043b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1333 microversion: 2.20 time: 0.181497 Jun 15 10:22:20.758674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 37/64] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1333 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:20.994316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:20.995540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.009053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.009778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.010780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.011355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.132519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.137088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.148010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.148460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.149454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.150190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.281273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.295414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f63004a-4c0d-4040-9c07-40c61065ddd9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.304888 Jun 15 10:22:21.298033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 28/65] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:20 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:21.311491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.320636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da83cfeb-8ac7-43cf-adb5-85e634cf1373 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1288 microversion: 2.1 time: 0.220534 Jun 15 10:22:21.334810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 38/66] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1288 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:21.413251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.413251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.413251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.413251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.414275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.414275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.435877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.436777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.444121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.444568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.445383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.445810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.475662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.483804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fa3509b-c782-4686-b2e0-22cafadc6301 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1279 microversion: 2.1 time: 0.095879 Jun 15 10:22:21.488816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 29/67] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:21.521439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.532629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-360dccfe-ffca-423e-8153-3a8a2f47189a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1298 microversion: 2.1 time: 0.100790 Jun 15 10:22:21.534108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 39/68] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:21.769428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.769996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:21.776391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.776841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.777645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:21.778080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:21.854414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.856637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c09d2c37-5df8-4cc9-9c68-895cb85bb680 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc27a223280>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:21.866421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.877689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:21.877689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-09d83db2-7fb3-4395-8dc6-160ef53dd450 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1333 microversion: 2.20 time: 0.108152 Jun 15 10:22:21.877689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 30/69] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:21.920746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c09d2c37-5df8-4cc9-9c68-895cb85bb680 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00251c15-20f9-44f8-9e14-d4924a12c060" status: 200 len: 350 microversion: 2.1 time: 0.068621 Jun 15 10:22:21.921367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 40/70] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:21 2022] GET /compute/v2.1/os-volumes/00251c15-20f9-44f8-9e14-d4924a12c060 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:22.316267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:22.317587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:22.324300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.324913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.325722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.326230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.338683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:22.339462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:22.346342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.346822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.347560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.347998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.370896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.429698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:22.437532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-292babc8-fdeb-4c63-98c0-8e6090ee1d09 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1288 microversion: 2.1 time: 0.102698 Jun 15 10:22:22.449125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 41/71] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:22.502565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:22.503327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:22.504249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:22.510893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ef4b64a6-26a2-4b8b-859f-2c9cdd24c4a9 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.198991 Jun 15 10:22:22.511990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 31/72] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:22 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:22.513190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.513856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.514667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.515101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.559130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:22.559130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:22.559130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.559413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.560126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.560761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.645663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:22.655928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d322c725-f1cf-4040-9890-f1a5aa16dfb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1298 microversion: 2.1 time: 0.109304 Jun 15 10:22:22.657035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 32/73] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:22.780257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:22.796741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b387df0-3e94-47a0-8073-2bd962215ee1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.299605 Jun 15 10:22:22.798727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 42/74] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:22 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:22.891292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:22.892920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:22.902244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.902244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:22.903161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:22.903919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.060144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.070780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.072469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.073650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4768547-15ec-4995-b116-0455662e8557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1341 microversion: 2.20 time: 0.188433 Jun 15 10:22:23.074210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 33/75] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:23.455305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:23.456449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:23.469086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.469258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.469946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.470423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.530968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:23.531648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:23.540658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.541210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.542017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.542453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.635768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.645823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0084bc4-f386-43db-9991-8a75719da3c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1296 microversion: 2.1 time: 0.194291 Jun 15 10:22:23.656799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 43/76] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:23.683929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:23.684538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:23.692213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.692661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.693477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.693902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.789258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.805331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-466b9f49-4876-4b35-a7a3-e6b17aad3606 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1298 microversion: 2.1 time: 0.125776 Jun 15 10:22:23.806417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 44/77] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:23.828016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:23.828893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:23.844173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.848886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.851661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:23.851661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:23.897119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:23.909609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-993c4902-10b6-4f5c-9129-dc64bb834670 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.382888 Jun 15 10:22:23.910170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 34/78] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:23 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:24.081779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:24.093185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8112ebfc-b53e-47d4-b1ac-029bd4d8f2c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.269603 Jun 15 10:22:24.094516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 45/79] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:23 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:24.095124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:24.095957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:24.112623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.113150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.114411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.115025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.261938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:24.271277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:24.273075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:24.274453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe2b3f02-73f4-49fe-9b39-1f835fdc56fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1351 microversion: 2.20 time: 0.184623 Jun 15 10:22:24.286326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 35/80] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:24.667953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:24.672177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:24.688038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.688740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.690448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.691027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.774848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0291c230-b991-4e21-8e43-e4fb7052abd9 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc279a79940>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:24.798507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:24.822593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25c63942-141e-4a17-9c19-076a83fc85d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1296 microversion: 2.1 time: 0.161703 Jun 15 10:22:24.828148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 46/81] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1296 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:24.843670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:24.845876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:24.854162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.854932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.856593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.857255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.882984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0291c230-b991-4e21-8e43-e4fb7052abd9 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8c34d2a0-8662-4a41-9394-22b3e695aa14" status: 200 len: 351 microversion: 2.1 time: 0.112653 Jun 15 10:22:24.888948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 36/82] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 10:22:24 2022] GET /compute/v2.1/os-volumes/8c34d2a0-8662-4a41-9394-22b3e695aa14 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:24.893178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-9d5a0a61-951e-41d1-8d36-4433ab0d9d33 req-4575b2ec-6ea5-4dc5-ab13-71339727cdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01adb0d3-da51-4b87-a318-7ec430d8d741", "tag": "16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:24.914013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-9d5a0a61-951e-41d1-8d36-4433ab0d9d33 req-4575b2ec-6ea5-4dc5-ab13-71339727cdd8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:24.916354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-9d5a0a61-951e-41d1-8d36-4433ab0d9d33 req-4575b2ec-6ea5-4dc5-ab13-71339727cdd8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:24.931435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:24.943229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-9d5a0a61-951e-41d1-8d36-4433ab0d9d33 req-4575b2ec-6ea5-4dc5-ab13-71339727cdd8 service nova] Creating event network-changed:16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2 for instance 01adb0d3-da51-4b87-a318-7ec430d8d741 on hv-cinder-84580 Jun 15 10:22:24.948781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-9d5a0a61-951e-41d1-8d36-4433ab0d9d33 req-4575b2ec-6ea5-4dc5-ab13-71339727cdd8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061216 Jun 15 10:22:24.949523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 37/83] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:24.957884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ce50aeb8-35bf-4674-8fb8-17a905bc29c0 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc279a154c0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.087012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ce50aeb8-35bf-4674-8fb8-17a905bc29c0 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.136044 Jun 15 10:22:25.087674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 38/84] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Jun 15 10:22:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:25.100446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.100446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:25.113516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.113943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.116719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.117725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.142552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.151245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62c5782c-145a-488b-885c-c3daa7a86f02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.320128 Jun 15 10:22:25.151830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 47/85] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:25.167176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5289b16b-672d-43a9-9668-3fade98655cf tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc27aa783a0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.284525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5289b16b-672d-43a9-9668-3fade98655cf tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.131260 Jun 15 10:22:25.285513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 48/86] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:25.291200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.293533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:25.302259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.303071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.304290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.305756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.335335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.344705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-382b77ae-7251-415a-a56a-cafa5b05dc7b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.255033 Jun 15 10:22:25.346593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 39/87] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:25.433897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-fde295ec-ea94-45d8-93f0-23c9741fbca0 req-87cff0e9-459e-4d89-836a-2fdc6ca6ce47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79", "tag": "55d1363c-0871-49ee-b169-b146f018e851"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:25.446599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-fde295ec-ea94-45d8-93f0-23c9741fbca0 req-87cff0e9-459e-4d89-836a-2fdc6ca6ce47 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.447038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-fde295ec-ea94-45d8-93f0-23c9741fbca0 req-87cff0e9-459e-4d89-836a-2fdc6ca6ce47 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.465083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-fde295ec-ea94-45d8-93f0-23c9741fbca0 req-87cff0e9-459e-4d89-836a-2fdc6ca6ce47 service nova] Creating event network-changed:55d1363c-0871-49ee-b169-b146f018e851 for instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 on hv-cinder-84580 Jun 15 10:22:25.469727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-fde295ec-ea94-45d8-93f0-23c9741fbca0 req-87cff0e9-459e-4d89-836a-2fdc6ca6ce47 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121870 Jun 15 10:22:25.472272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 40/88] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:25.476683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3d02612-08e2-497b-9f6b-2dc2f548835d tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc279a15430>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.560890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.571025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b889901-61bb-49f4-9a44-f9e7f6008478 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.283814 Jun 15 10:22:25.572503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 49/89] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:25.585434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3d02612-08e2-497b-9f6b-2dc2f548835d tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109912 Jun 15 10:22:25.585614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.586286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:25.593094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 41/90] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:25.593705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.595579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.596936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.597463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.598874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b3a9380-f694-4b07-a1b3-589c57bc55a2 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc2799d0ca0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.730124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b3a9380-f694-4b07-a1b3-589c57bc55a2 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.135679 Jun 15 10:22:25.731339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 42/91] 10.222.0.60 () {58 vars in 1166 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:25.744689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d32dc39-35e9-4b21-b4d9-b886ddc97af2 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc2799c3550>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.884546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.889432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d32dc39-35e9-4b21-b4d9-b886ddc97af2 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.148832 Jun 15 10:22:25.890354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 43/92] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:25.898613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:25.898613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:25.910783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.912858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:25.914153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.914283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b08ff9be-0b61-4d45-87bb-874a95ddbab5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1351 microversion: 2.20 time: 0.340710 Jun 15 10:22:25.914616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.915334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 50/93] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1351 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:25.918589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:25.921222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:25.933468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cef1d87d-d600-41bc-890a-97d863238aec tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc27aa78670>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.028491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:26.039894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-46808dc8-f49d-4ea1-83a6-ea455017a2b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1296 microversion: 2.1 time: 0.148406 Jun 15 10:22:26.040657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 44/94] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1296 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:26.103236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cef1d87d-d600-41bc-890a-97d863238aec tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.174515 Jun 15 10:22:26.104239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 51/95] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Jun 15 10:22:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:26.118637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d78d2124-0622-4273-9ced-66d4523fe366 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc279a15550>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.177205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.179574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:26.190718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.191797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.197557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.197557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.219175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d78d2124-0622-4273-9ced-66d4523fe366 tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105438 Jun 15 10:22:26.219941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 45/96] 10.222.0.60 () {58 vars in 1187 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:26.233926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ad6b923-b366-4d7c-96c7-54f4cc319f2e tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] Calling method '.version_select at 0x7fc2799d0160>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.349372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ad6b923-b366-4d7c-96c7-54f4cc319f2e tempest-VolumesTestJSON-1203623054 tempest-VolumesTestJSON-1203623054-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.120015 Jun 15 10:22:26.361694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 46/97] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:26.371810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.372684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:26.393500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.394054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.395126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.397645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.579170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.618062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.698807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:26.710536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ef83b19f-6eba-4e58-bf63-89f3f95092f0 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.346629 Jun 15 10:22:26.727188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 47/98] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:26.729113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.729648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:26.736004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.737175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.738019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.738640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.903090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:26.912125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-71df244e-6d20-418c-be7a-43a123819222 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.191710 Jun 15 10:22:26.913689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 48/99] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:26.946702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:26.948572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:26.958471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.959409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:26.960837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:26.961491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.039037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:27.048262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:27.049885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:27.051092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2805472c-2fa7-4f73-880b-2a947e19c1d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1339 microversion: 2.20 time: 0.122417 Jun 15 10:22:27.057738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 49/100] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:27.065807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:27.066903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:27.073902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.074644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.083627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.083627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.159288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:27.167042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38bd247e-9000-4476-994c-5fa3797f5296 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1294 microversion: 2.1 time: 0.107821 Jun 15 10:22:27.167618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 50/101] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:27.217285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:27.222421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02f451ac-e189-45a1-b659-cb1f2c1db7be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 1.055470 Jun 15 10:22:27.223511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:27.498393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e3629ad9-b710-46ca-8d41-247fb25dc6d0 req-6978fb93-b7ca-4667-8f88-3a6f33726a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4944d55-b710-413e-81ed-24e682fa5479", "tag": "27e773d4-aed6-4a80-bac1-bbb3f07bf3e2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:27.515125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e3629ad9-b710-46ca-8d41-247fb25dc6d0 req-6978fb93-b7ca-4667-8f88-3a6f33726a05 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.515985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e3629ad9-b710-46ca-8d41-247fb25dc6d0 req-6978fb93-b7ca-4667-8f88-3a6f33726a05 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.566779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e3629ad9-b710-46ca-8d41-247fb25dc6d0 req-6978fb93-b7ca-4667-8f88-3a6f33726a05 service nova] Creating event network-changed:27e773d4-aed6-4a80-bac1-bbb3f07bf3e2 for instance c4944d55-b710-413e-81ed-24e682fa5479 on hv-cinder-84580 Jun 15 10:22:27.578712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e3629ad9-b710-46ca-8d41-247fb25dc6d0 req-6978fb93-b7ca-4667-8f88-3a6f33726a05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092326 Jun 15 10:22:27.586698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 51/103] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:27.734283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:27.734992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:27.765625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.766405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.767970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.768636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.931034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:27.932945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:27.942157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.943166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:27.947137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:27.960285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.019210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=7 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:28.030897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=24 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:28.303189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.310959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4638933-4226-4225-895f-1a85e53137ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.384507 Jun 15 10:22:28.321724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 52/104] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:27 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:28.321724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:28.321724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:28.325742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.326368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.327282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.327876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.354863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.369801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ae4a2ea-1208-4720-bab9-3dc3a54f8254 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.639488 Jun 15 10:22:28.370385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 53/105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:27 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:28.375360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:28.381507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:28.400670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.401449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.402367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.403043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.493879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.509726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.509726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.509726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f25e473a-fd79-49b4-ba79-90efacddb76f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1339 microversion: 2.20 time: 0.194464 Jun 15 10:22:28.510066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 53/106] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:28.515475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:28.516014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:28.527122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.530345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.533242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:28.534044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:28.868213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:28.876870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-95466b69-f509-44a8-b283-bfac8e2a902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1294 microversion: 2.1 time: 0.505039 Jun 15 10:22:28.886590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1294 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:29.055062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.072610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d722712-2b1c-4127-a777-bb82a9011520 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.562387 Jun 15 10:22:29.073833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:29.331694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:29.331694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:29.343406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.344799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.346633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.347480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.390699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:29.391608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:29.400417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.401770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.403638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.404572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.654746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.664044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-328ae0bb-c7ab-43ce-b63a-b1544923f27d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.277498 Jun 15 10:22:29.664774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 55/109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:29 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:29.681776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:29.682639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:29.723055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.725203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.728072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.728688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.900781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.913473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9557805d-eccc-46aa-a841-0768450cc795 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.588399 Jun 15 10:22:29.914840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 55/110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:29 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:29.928903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.940370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.942332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:29.943490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a8e075af-0d0c-4173-b5cb-1e3fd84cd06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.277634 Jun 15 10:22:29.944050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 56/111] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:29.949140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:29.949761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:29.956766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.959611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:29.960646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:29.961138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.002062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-6b9feabd-561a-4932-b8fd-dbc80ed07441 req-5aea5222-07fd-42ee-a988-a214f10bbda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d5f4f7-99d7-4850-9719-aad011589217", "name": "network-vif-plugged", "status": "completed", "tag": "0c64e3fd-8b7d-4790-90b8-b06051a70d29"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:30.045533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6b9feabd-561a-4932-b8fd-dbc80ed07441 req-5aea5222-07fd-42ee-a988-a214f10bbda0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.045533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6b9feabd-561a-4932-b8fd-dbc80ed07441 req-5aea5222-07fd-42ee-a988-a214f10bbda0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.088753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-6b9feabd-561a-4932-b8fd-dbc80ed07441 req-5aea5222-07fd-42ee-a988-a214f10bbda0 service nova] Creating event network-vif-plugged:0c64e3fd-8b7d-4790-90b8-b06051a70d29 for instance 36d5f4f7-99d7-4850-9719-aad011589217 on hv-cinder-84580 Jun 15 10:22:30.089339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-6b9feabd-561a-4932-b8fd-dbc80ed07441 req-5aea5222-07fd-42ee-a988-a214f10bbda0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:22:30.091671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.092050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.093723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.096442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.106694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.compute.rpcapi [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:22:30.108044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=118120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:22:30.141250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5581eeef-c5ac-45a7-9b03-76b00d0e82b1 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222243 Jun 15 10:22:30.141250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 56/112] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:30.151797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:30.153523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:30.163118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:30.163933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.164551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.165522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.166106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.171365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4e3cf53-e47d-4f96-ac39-008f79b4ff89 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.226021 Jun 15 10:22:30.174143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 57/113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:30.362532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:30.370055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97062407-c383-4325-aaa3-c7ed62cd2311 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.228822 Jun 15 10:22:30.370618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 57/114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:30.681411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:30.681889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:30.687950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.688400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.689937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.690380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.828826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:30.840235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa322762-8438-4032-b686-1b08ba26d772 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.162473 Jun 15 10:22:30.841269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 58/115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:30 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:30.940428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:30.941100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:30.947650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.948095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.948854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.949315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.962639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:30.963369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:30.970566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.971178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:30.972006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:30.972442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.130445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.140095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.141901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.143471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a198f5c4-8224-4529-9051-41fd4cc69aa0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.184895 Jun 15 10:22:31.144115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.144786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 59/116] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:31.152598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3431f1e1-5e1c-4ce3-b38a-d27ce83be52a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.216535 Jun 15 10:22:31.153626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 58/117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:30 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:31.190794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:31.191769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:31.198361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.198826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.199612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.200044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.345899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.355628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-00543076-ef10-4a53-86ad-e311ce99f732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.168820 Jun 15 10:22:31.366633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 60/118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:31.388612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:31.390244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:31.405758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.406212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.407019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.408152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.822636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:31.846043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f28632a8-2653-451b-a193-7cbd4f03d8d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.461607 Jun 15 10:22:31.847560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 59/119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:31.864494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:31.865154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:31.874190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.875036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:31.876268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:31.877123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.058645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.063279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:32.069424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-877a13fa-f882-4eff-9beb-bb2dce48d49b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.209496 Jun 15 10:22:32.070528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 61/120] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:31 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:32.163584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:32.164933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:32.171708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:32.172326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:32.173082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.174538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.175576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.176229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.182545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.182998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.183822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.186612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.206860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:32.414131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.425887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d0e7f3c0-c008-4666-aeb6-1e241b374ce0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.258671 Jun 15 10:22:32.427107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.435913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 62/121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:32 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:32.447757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.456146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.460148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e310df73-2cf8-4fc8-8c55-973614a6a328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.300406 Jun 15 10:22:32.460748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 60/122] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:32.471134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:32.473142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:32.481383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.482155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.488089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.488782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.710616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:32.729272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6cb7d68-0e8b-49df-96c2-cd4779561707 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.291854 Jun 15 10:22:32.733755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 63/123] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:32.872354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:32.874068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:32.901464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.903638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:32.906019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:32.906906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.091994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:33.093559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:33.118324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.122709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.127528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.128358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.375286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.395093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e807532b-6f8f-41af-99df-bbef09f65e85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.533975 Jun 15 10:22:33.395693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 61/124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:33.431045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-89b30dea-c811-4adc-beac-d4348fa2f6da req-f679f44e-e6e8-4442-bc8a-50e2540f7b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a5478-7be1-4af4-913f-48a2c5ee7199", "tag": "b7da9a2f-05fc-414c-ae2d-5271d90eaedb"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:33.464477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-89b30dea-c811-4adc-beac-d4348fa2f6da req-f679f44e-e6e8-4442-bc8a-50e2540f7b5c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.465190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-89b30dea-c811-4adc-beac-d4348fa2f6da req-f679f44e-e6e8-4442-bc8a-50e2540f7b5c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.494309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-89b30dea-c811-4adc-beac-d4348fa2f6da req-f679f44e-e6e8-4442-bc8a-50e2540f7b5c service nova] Creating event network-changed:b7da9a2f-05fc-414c-ae2d-5271d90eaedb for instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 on hv-cinder-84580 Jun 15 10:22:33.512576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-89b30dea-c811-4adc-beac-d4348fa2f6da req-f679f44e-e6e8-4442-bc8a-50e2540f7b5c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092260 Jun 15 10:22:33.513462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 62/125] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:33.529865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:33.531154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:33.539741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.543935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.543935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.543935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.615359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.623313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a070815-8c4a-4b22-ba58-8e741059c61f tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.539268 Jun 15 10:22:33.634820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 64/126] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:33 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:33.642519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:33.643811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:33.650471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.651078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.651981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.652539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.817792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.827380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56607d95-df77-4216-9191-8fb45856b1d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.310868 Jun 15 10:22:33.830350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 63/127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:33 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:33.837234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:33.839444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:33.863959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.867302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.869934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:33.874479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:33.887690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.903650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.906213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:33.908576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-54954e11-e570-4c4f-bf91-57461c4c3cc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.271986 Jun 15 10:22:33.909516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 65/128] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:34.091537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:34.100540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-509cbd15-1585-479f-96f8-8b3aea794945 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.269091 Jun 15 10:22:34.101991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 64/129] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:34.412191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:34.413327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:34.420027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.424471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.424471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.424471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.575882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:34.585049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-06dd5d9b-36ce-4e1d-a21a-b0c583142ca0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.177240 Jun 15 10:22:34.585622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:34.641196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:34.641937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:34.648598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.649241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.650114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.650608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.817705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:34.826697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4740d5a6-fdca-4565-bfc3-2cca2e89916e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.189707 Jun 15 10:22:34.827275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 65/131] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:34 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:34.848884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:34.849536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:34.855590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.855988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.856746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.857227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.927999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:34.928702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:34.934783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.935238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:34.936047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:34.936490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.000609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:35.005638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e5320d3-f1ac-4c6f-a65f-04dbcf8c7965 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.162125 Jun 15 10:22:35.006528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 67/132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:34 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:35.101806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:35.121340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:35.121340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:35.121340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5e8fab24-3775-44fa-89cb-bf71039c1710 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.190891 Jun 15 10:22:35.121577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 66/133] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:35.121645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:35.121925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:35.129698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.130147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.130917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.131349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.279653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:35.289367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45321272-438a-4fdf-bd8b-4d67945d9d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.172615 Jun 15 10:22:35.297024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 68/134] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:35.554413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-17062745-a3f9-4b73-9177-9072f157ad3c req-18758f95-c82d-4614-9e96-a565a60eadbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79", "name": "network-vif-plugged", "status": "completed", "tag": "55d1363c-0871-49ee-b169-b146f018e851"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:35.559449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-727f833c-79f6-4b10-ae24-07ac5226e64c req-979a64e3-6138-4f34-b086-39e8b9b8ef8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:35.567344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-17062745-a3f9-4b73-9177-9072f157ad3c req-18758f95-c82d-4614-9e96-a565a60eadbf service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.574328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-17062745-a3f9-4b73-9177-9072f157ad3c req-18758f95-c82d-4614-9e96-a565a60eadbf service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.574460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-727f833c-79f6-4b10-ae24-07ac5226e64c req-979a64e3-6138-4f34-b086-39e8b9b8ef8d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.574460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-727f833c-79f6-4b10-ae24-07ac5226e64c req-979a64e3-6138-4f34-b086-39e8b9b8ef8d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.584528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-17062745-a3f9-4b73-9177-9072f157ad3c req-18758f95-c82d-4614-9e96-a565a60eadbf service nova] Creating event network-vif-plugged:55d1363c-0871-49ee-b169-b146f018e851 for instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 on hv-cinder-84580 Jun 15 10:22:35.586393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-727f833c-79f6-4b10-ae24-07ac5226e64c req-979a64e3-6138-4f34-b086-39e8b9b8ef8d service nova] Creating event network-changed:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:22:35.592134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-727f833c-79f6-4b10-ae24-07ac5226e64c req-979a64e3-6138-4f34-b086-39e8b9b8ef8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036897 Jun 15 10:22:35.594587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-17062745-a3f9-4b73-9177-9072f157ad3c req-18758f95-c82d-4614-9e96-a565a60eadbf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045297 Jun 15 10:22:35.596302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 67/135] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:35.599392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 69/136] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:35.605604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:35.606381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:35.613588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.614118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.614973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.615481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.844687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:35.846459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:35.864876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.866353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:35.867672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:35.868578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.096320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.106903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65d9b827-6339-4d29-8eb0-64c3dacc0bff tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.266782 Jun 15 10:22:36.112172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 70/137] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:35 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:36.127430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:36.128648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:36.131930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:36.135913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.136357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.137484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.138066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.392709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.404574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ffa6a7c-3474-4671-b07b-fa1cecd88c37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.281828 Jun 15 10:22:36.412075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 71/138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:36 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:36.418837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:36.420221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:36.428807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.429805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.431003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.431633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.522483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.546760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9604dc6d-7931-4e86-ae45-20c68c09508c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.946135 Jun 15 10:22:36.547342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 68/139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:36.562245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:36.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:36.569987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.570962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.572164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:36.574372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:36.648384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.660188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.661819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.662980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-540f12df-23ba-47e4-af36-f7e2ee5c4772 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.252528 Jun 15 10:22:36.663736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 72/140] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:36.898679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:36.906542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32d6d1ad-132b-4f48-8bbe-275a29dab2de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.348407 Jun 15 10:22:36.907130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 69/141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:37.129067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:37.129674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:37.136769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.137551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.138424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.139299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.344016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.353100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ff3a2fb-e2ea-4ef9-9104-b2c97196119b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.228025 Jun 15 10:22:37.354310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 73/142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:37 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:37.423832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:37.424678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:37.431034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.433134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.433134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.433134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.564584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:37.565822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:37.576338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.576338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.576338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.576338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.577073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.583903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c11c223-c849-478e-bca5-f6d05e30038e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.164771 Jun 15 10:22:37.584508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 70/143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:37 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:37.609932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-b04e90d3-57c1-47fb-b818-c914abc6fca0 req-af80cb02-116d-4a46-91f6-7cd2be97b49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01adb0d3-da51-4b87-a318-7ec430d8d741", "name": "network-vif-plugged", "status": "completed", "tag": "16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:37.618983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b04e90d3-57c1-47fb-b818-c914abc6fca0 req-af80cb02-116d-4a46-91f6-7cd2be97b49d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.619432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b04e90d3-57c1-47fb-b818-c914abc6fca0 req-af80cb02-116d-4a46-91f6-7cd2be97b49d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.632011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-b04e90d3-57c1-47fb-b818-c914abc6fca0 req-af80cb02-116d-4a46-91f6-7cd2be97b49d service nova] Creating event network-vif-plugged:16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2 for instance 01adb0d3-da51-4b87-a318-7ec430d8d741 on hv-cinder-84580 Jun 15 10:22:37.637256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-b04e90d3-57c1-47fb-b818-c914abc6fca0 req-af80cb02-116d-4a46-91f6-7cd2be97b49d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030769 Jun 15 10:22:37.637954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 71/144] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:37.683554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:37.684375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:37.692370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.692919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.693796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.694299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.724639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.732935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fc34e5a-7911-4a4d-95ed-302842731516 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.172911 Jun 15 10:22:37.733542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 74/145] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:37.858305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.867145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.868618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:37.869757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f24628c-af75-4de1-afed-070e1262b68d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.190879 Jun 15 10:22:37.870320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 72/146] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:37.924981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:37.925640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:37.932328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.932811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:37.933602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:37.934026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.078988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:38.087636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a6dfa17-3f1c-4400-9789-55c43e1c08f4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.167406 Jun 15 10:22:38.088434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 75/147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:38.371248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:38.371860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:38.378151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.378600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.379367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.379806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.541794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:38.550599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8df15039-57f7-4d8e-878d-04ab1d7bdf3b tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1314 microversion: 2.1 time: 0.183177 Jun 15 10:22:38.551412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 73/148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:38 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:38.601060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:38.601677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:38.607913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.608367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.609147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.609576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.752097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:38.753352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:38.756349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:38.762722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.763390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.765088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.765564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.791809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:38.801984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-987da63d-5929-423c-bfd8-b07016ffa880 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.202463 Jun 15 10:22:38.809046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 76/149] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:38 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:38.889450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:38.890291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:38.897989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.898640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:38.899571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:38.900146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.003746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.018030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d50f21c1-5b7d-434d-9c6f-a0e1431c90b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.270735 Jun 15 10:22:39.018901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 74/150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:39.105738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:39.106691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:39.114143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.114928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.115806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.116429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.158253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.167947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.169506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.170874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a05bf1c6-81a0-4244-84b1-71e6dad0a861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.285882 Jun 15 10:22:39.177045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 77/151] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:39.279899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.289519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee3c975b-fc8f-4be3-880a-64dbb0db0fad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.187736 Jun 15 10:22:39.293564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 75/152] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:39.569256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:39.569817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:39.575792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.576227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.576991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.577451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.718900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.726904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84327b72-f259-4ad0-9dab-0212fef4db46 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1502 microversion: 2.1 time: 0.162517 Jun 15 10:22:39.727488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 78/153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:39 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:39.817763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:39.818380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:39.825175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.825623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.826410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:39.826840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:39.964013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:39.972819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-28a7edb4-4fb8-4660-98c7-dbdc1b4f3608 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.160139 Jun 15 10:22:39.973431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 76/154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:39 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:40.036090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:40.036896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:40.043463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.044183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.044976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.045430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.049874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.192193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:40.192806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:40.194694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.199567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.203613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.203613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.203613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.208110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:40.215797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23dfcbad-2db0-45bf-b3e8-66d51bcafa44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.184703 Jun 15 10:22:40.216522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 79/155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:40.309282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:40.310783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:40.319537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.320241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.321371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.322028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:40.348520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:40.366383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:40.367869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:40.369119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4120197d-d22e-4367-9f22-2917a705f5aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.181081 Jun 15 10:22:40.369732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 77/156] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:40.508081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:40.516568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b7060d9-0adf-40ba-ad4e-ed123871d9da tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.212514 Jun 15 10:22:40.529712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 80/157] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:40.991934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:40.992713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:40.999489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:40.999934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.000753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.001494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.154823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.163196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-882a8298-bf3d-4a8b-bd4b-497bf4288aab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.176112 Jun 15 10:22:41.163831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 78/158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:40 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:41.234304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:41.234910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:41.241795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.242237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.242996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.243423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.388196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:41.388802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:41.393804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.397413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.398034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.398957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.399383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.402448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-527eafd3-890e-4f51-874b-a969ee9d5106 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.172182 Jun 15 10:22:41.403098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 81/159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:41.404118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:41.540165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:41.541436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:41.551652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.551865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.552329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.553201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:41.554256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:41.560413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.566818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.566818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d748c70e-f796-47ea-aaac-a5a21ff6a0de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.179272 Jun 15 10:22:41.566818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 79/160] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:41.713446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:41.721742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-061546bd-de8b-4417-9427-ee9539c9ce76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.186688 Jun 15 10:22:41.722311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 82/161] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:42.180615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:42.181296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:42.189799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.193119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.193119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.193119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.371497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.383641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-579ecfc1-3d5e-425e-9b6b-e6a4401ccf2c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.206950 Jun 15 10:22:42.388091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 80/162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:42 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:42.431996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:42.431996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:42.431996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.431996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.432707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.432707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.584732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:42.585478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:42.592323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.592763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.593566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.593997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.637021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.651912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-256cb3ae-549a-4bc1-b1f1-182b3cfc242c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.235703 Jun 15 10:22:42.654345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 83/163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:42.739381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:42.740173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:42.747585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.753366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.754329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:42.757194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:42.792325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.803203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.805190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.807151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa9ebb39-1035-4e4b-b0b7-b1baa2a95f58 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.228363 Jun 15 10:22:42.807869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 81/164] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:42.968041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:42.997751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9257daa0-2dd6-46d8-8f69-6d955dd9171d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.263291 Jun 15 10:22:42.998351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 84/165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:43.014782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-b65dea4d-81db-402d-a3bf-f58348ed21f8 req-21e6a0e1-a22a-4edf-844b-81096e33daad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4944d55-b710-413e-81ed-24e682fa5479", "name": "network-vif-plugged", "status": "completed", "tag": "27e773d4-aed6-4a80-bac1-bbb3f07bf3e2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:43.034711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b65dea4d-81db-402d-a3bf-f58348ed21f8 req-21e6a0e1-a22a-4edf-844b-81096e33daad service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.035234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-b65dea4d-81db-402d-a3bf-f58348ed21f8 req-21e6a0e1-a22a-4edf-844b-81096e33daad service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.070655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-b65dea4d-81db-402d-a3bf-f58348ed21f8 req-21e6a0e1-a22a-4edf-844b-81096e33daad service nova] Creating event network-vif-plugged:27e773d4-aed6-4a80-bac1-bbb3f07bf3e2 for instance c4944d55-b710-413e-81ed-24e682fa5479 on hv-cinder-84580 Jun 15 10:22:43.085597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-b65dea4d-81db-402d-a3bf-f58348ed21f8 req-21e6a0e1-a22a-4edf-844b-81096e33daad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079992 Jun 15 10:22:43.086218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 82/166] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:43.402494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:43.403116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:43.409673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.410122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.410895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.411372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.565280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:43.583446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d9017c5d-5140-4e3b-baec-de4eac9647d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.184753 Jun 15 10:22:43.584605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 85/167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:43 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:43.680584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:43.687391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:43.724105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.724105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.724105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.729334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.776771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1211969-b94a-44f1-9df8-a7a8fe55be09"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:43.777944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:43.790864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.791440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.792231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.792661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.943539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:43.951866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04a96ada-4167-42a4-891b-09ceebe07620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.275423 Jun 15 10:22:43.952428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 83/168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:43.958435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:43.959026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:43.965635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.966270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:43.967385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:43.967821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:44.135663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:44.144517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:44.146006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:44.147153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bad74357-4820-47c0-99c9-99aa7bab1fdc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.193817 Jun 15 10:22:44.147732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 84/169] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:44.152064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:44.156767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:44.159811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:44.160251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:44.161031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:44.161457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:44.324152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:44.333263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2e03ef2-fc7e-4fe3-b732-18c60830d1e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.184486 Jun 15 10:22:44.343625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 85/170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:44.601541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:44.602522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:44.610950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:44.611686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:44.612494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:44.612933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:44.764302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:44.777325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-098b9183-2f46-49f3-a21b-d99a36dfbbf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.180135 Jun 15 10:22:44.778470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 86/171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:44 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:44.970371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:44.971369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:44.999746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.002072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.005788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.009461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.216319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.224995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb907558-df15-4baa-8a97-4e1e6a976632 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.258951 Jun 15 10:22:45.234605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 87/172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:45.234605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:45.234605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:45.240210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.241473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.242295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.242727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.425108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.433805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.435304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.437152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7417f389-966a-4399-8690-0f7b8772ef20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.209856 Jun 15 10:22:45.437152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 88/173] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:45.442869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:45.445389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:45.452294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.452737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.454786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.454786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.598669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.606349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca281ab7-7b12-4cd6-8f8a-50956620ae5a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.168374 Jun 15 10:22:45.606923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 89/174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:45.797286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:45.798704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:45.804758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.805236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.806187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:45.806678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:45.910601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6cb7c18e-e941-488a-8a03-edce12220039 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "POST /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.137055 Jun 15 10:22:45.912578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 86/175] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:22:43 2022] POST /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217/os-volume_attachments => generated 194 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:45.972446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:45.981714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-187a9f04-12d9-4039-a779-a4e896080464 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1321 microversion: 2.1 time: 0.188073 Jun 15 10:22:45.982283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 90/176] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:45 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:46.244392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:46.245148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:46.254262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.254714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.255589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.256090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.439222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:46.450884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7893379e-8e75-4246-9129-8965ad40e119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.209936 Jun 15 10:22:46.451922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 87/177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:46.458610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:46.462202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:46.469143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.470086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.470876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.471323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.626637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:46.627925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:46.633596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:46.634951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.635564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.636342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:46.636768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:46.648373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:46.650140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:46.651351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f1b7f4c-1af0-47ec-9825-12703db259a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.199334 Jun 15 10:22:46.651926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 91/178] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:46.808359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:46.822163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f70767a1-bd48-4a67-9808-34db25a9a610 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.200787 Jun 15 10:22:46.823194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 88/179] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:47.003300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.003986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.012275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.012674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.013513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.013948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.206202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.213858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1b46f95-e1e2-4b02-908d-ff923c25e28f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1513 microversion: 2.1 time: 0.215652 Jun 15 10:22:47.214420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 92/180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:46 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:47.232730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:47.233755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.241615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.242049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.242853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.243483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.267679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'flavor' on Instance uuid 01adb0d3-da51-4b87-a318-7ec430d8d741 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:22:47.473957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.474832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.481983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.482601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.483893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.484259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.660621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-24ae334e-ee33-424e-b72e-933d7da62722 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741/action" status: 200 len: 32 microversion: 2.1 time: 0.432068 Jun 15 10:22:47.661602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 89/181] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:22:47 2022] POST /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 10:22:47.677426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.681270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.683212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.690565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.691748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.693259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.694211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bcd948c9-ca9e-4bd4-81a8-8ccb23bde1dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.224161 Jun 15 10:22:47.694714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.709199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 93/182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:47.709199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.709199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.710052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.710052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.710906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.711551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.925230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.941703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.947703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.950584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-102f693b-4fd3-4b21-b7aa-5ee285af4679 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.281600 Jun 15 10:22:47.951981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:47.952226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 90/183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:47 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:47.962970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:47.968112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:47.971373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec8d8e53-bbb4-461c-9558-18f20617d0fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.260107 Jun 15 10:22:47.971578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.972081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:47.973366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 94/184] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:47.980670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:47.981169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.214686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:48.223800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a3ca03e-a710-46b6-9e84-aba7d97a8d64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.266509 Jun 15 10:22:48.224567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 91/185] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:48.727787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:48.728399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:48.734879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.735328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.736097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.736528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.976981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:48.978531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:48.989471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.990389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:48.991939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:48.992613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.018435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:49.166916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.175963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eff610ae-bed4-482c-a1e6-2a58db22fd75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.203192 Jun 15 10:22:49.176541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 92/186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:48 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:49.194623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:49.195262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:49.206104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.206808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.207584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.208007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.229652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.245065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5c94737-3ef0-4f8f-b63f-88ff174cf9ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.520688 Jun 15 10:22:49.246037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 95/187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:49.253936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:49.254945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:49.265085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.265801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.267091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:49.267879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:49.303494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:49.456948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.468950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.472295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.473288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:49.473761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-24ffd065-da38-434d-9b0b-9707b2513557 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.296097 Jun 15 10:22:49.474871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 93/188] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:49.491766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7eeb4049-b798-426f-8c9a-49f484c73ba8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.243448 Jun 15 10:22:49.491766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 96/189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:50.204804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:50.205642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:50.213872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.214678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.215484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.218842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.263807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:50.264942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:50.276105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.276105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.277170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.278087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.419691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.435028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3fe50a1-9d15-4950-b2cd-25ae9037a5ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.234169 Jun 15 10:22:50.436375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 94/190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:50 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:50.482970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.492289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24ca3eb6-4143-4a28-8ec0-0af8dad8c694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.233586 Jun 15 10:22:50.493062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 97/191] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:50.497410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:50.498476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:50.509621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:50.510366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.510698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:50.510826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.511774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.512418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.521469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.527871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.527871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:50.527871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:50.823287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.832929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e79ceaa-8186-464b-9db9-5e14277cf43d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.326999 Jun 15 10:22:50.834126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 98/192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:50.899074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.911151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.913996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:50.915563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6d61e413-2db4-4aa7-9993-0394cbdc2d99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.426675 Jun 15 10:22:50.916516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 95/193] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:51.463096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:51.464348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:51.472203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.472914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.473992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.474529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.510524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:51.511114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:51.519836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.520530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.521525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.522158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.634978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:51.647023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b268fd49-ad9a-4e46-9429-dc8aa67f8f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.188625 Jun 15 10:22:51.647692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 99/194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:51 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:51.697031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:51.707966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f5451f4d-292d-4eff-8a3e-f23597b39c43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1366 microversion: 2.1 time: 0.201135 Jun 15 10:22:51.708773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 96/195] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:51.851568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:51.852300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:51.858893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.859336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.860654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.861180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.939424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:51.940201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:51.948773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.949305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:51.950436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:51.950823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.021592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.038347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d5346563-47b4-4822-a5d1-683b6f706579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.185420 Jun 15 10:22:52.040406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 100/196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:52.137860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.151109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.152818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.154023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a0d9fdb-f656-4e51-8b60-85af55a5b06f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.219478 Jun 15 10:22:52.154940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 97/197] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:52.664071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:52.664678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:52.672423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.673550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.676453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.676453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.742618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:52.742618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:52.742618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.742618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.743397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.743397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.906774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:52.932670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19e8958a-7a64-45ce-bc16-5a053a447285 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1557 microversion: 2.1 time: 0.194546 Jun 15 10:22:52.932670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 98/198] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1557 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:52.952847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:52.953373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:52.960737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.961206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:52.966905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:52.968433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.060398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.067706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-46fb4100-d5ce-4452-815c-3c7ad270cc5c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118838 Jun 15 10:22:53.068876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 99/199] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:22:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:53.073746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:53.074585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:53.075543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09efa104-abdc-4241-a9aa-16aef0a47473 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.414966 Jun 15 10:22:53.079169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 101/200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:52 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:53.094376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.095649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.096537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.097088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.173912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:53.175221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:53.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.483934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.499357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.499357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.499967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e7d417f-fd14-4c51-94e3-318ad70c113b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.331464 Jun 15 10:22:53.509606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 102/201] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:53.515613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-3e3cb146-412a-45e2-b8c0-4d5bc4051e7d req-975c3f9a-cc75-401b-b858-a80b763a0377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "name": "network-vif-plugged", "status": "completed", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:53.541196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-3e3cb146-412a-45e2-b8c0-4d5bc4051e7d req-975c3f9a-cc75-401b-b858-a80b763a0377 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.542163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-3e3cb146-412a-45e2-b8c0-4d5bc4051e7d req-975c3f9a-cc75-401b-b858-a80b763a0377 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.557197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:53.573671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a8ea1ba-7b62-4cc7-ae7e-b83970e31525 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.503520 Jun 15 10:22:53.575232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 100/202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:53.580309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-3e3cb146-412a-45e2-b8c0-4d5bc4051e7d req-975c3f9a-cc75-401b-b858-a80b763a0377 service nova] Creating event network-vif-plugged:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:22:53.587236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-3e3cb146-412a-45e2-b8c0-4d5bc4051e7d req-975c3f9a-cc75-401b-b858-a80b763a0377 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075778 Jun 15 10:22:53.588725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 103/203] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:54.095371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:54.096224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:54.103578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.104252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.105224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.105914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.413041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.424434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b0d73010-3e6f-4e8b-9a88-f4372a978596 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.333961 Jun 15 10:22:54.425047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 101/204] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:54 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:54.525550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:54.526902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:54.534897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.535347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.536359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.536713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.601443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:54.602492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:54.615005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.615548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.616646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:54.617214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:54.723412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.734230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.736789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:54.738173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3abfb66c-9506-440e-bf00-5ee61c7f0e05 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.218367 Jun 15 10:22:54.739508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 104/205] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:55.112551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.120676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f7f10c86-3af5-428b-90af-aa75b0fbc366 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.531309 Jun 15 10:22:55.129211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 102/206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:55.324853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-a93ff39c-64bf-4f25-8b1b-f8506f9681e3 req-087dff50-c309-4e86-8b7d-ce184ab3d4fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4944d55-b710-413e-81ed-24e682fa5479", "tag": "27e773d4-aed6-4a80-bac1-bbb3f07bf3e2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:55.335395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-a93ff39c-64bf-4f25-8b1b-f8506f9681e3 req-087dff50-c309-4e86-8b7d-ce184ab3d4fe service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.336014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-a93ff39c-64bf-4f25-8b1b-f8506f9681e3 req-087dff50-c309-4e86-8b7d-ce184ab3d4fe service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.347877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-a93ff39c-64bf-4f25-8b1b-f8506f9681e3 req-087dff50-c309-4e86-8b7d-ce184ab3d4fe service nova] Creating event network-changed:27e773d4-aed6-4a80-bac1-bbb3f07bf3e2 for instance c4944d55-b710-413e-81ed-24e682fa5479 on hv-cinder-84580 Jun 15 10:22:55.353008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-a93ff39c-64bf-4f25-8b1b-f8506f9681e3 req-087dff50-c309-4e86-8b7d-ce184ab3d4fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032501 Jun 15 10:22:55.353949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 105/207] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:55.447341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:55.448563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:55.455257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.455778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.458336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.460622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.637615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.639571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-79157a02-c78e-4e1c-b18e-32f55281d209 req-f15b6b20-cd54-4265-9cb6-a1b36d68addd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3a5478-7be1-4af4-913f-48a2c5ee7199", "name": "network-vif-plugged", "status": "completed", "tag": "b7da9a2f-05fc-414c-ae2d-5271d90eaedb"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:22:55.640254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b041feaa-4073-4911-8a4a-e4b89bd1ecf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.200486 Jun 15 10:22:55.641421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 103/208] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:55 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:55.659049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-79157a02-c78e-4e1c-b18e-32f55281d209 req-f15b6b20-cd54-4265-9cb6-a1b36d68addd service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.661735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-79157a02-c78e-4e1c-b18e-32f55281d209 req-f15b6b20-cd54-4265-9cb6-a1b36d68addd service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.697659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-79157a02-c78e-4e1c-b18e-32f55281d209 req-f15b6b20-cd54-4265-9cb6-a1b36d68addd service nova] Creating event network-vif-plugged:b7da9a2f-05fc-414c-ae2d-5271d90eaedb for instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 on hv-cinder-84580 Jun 15 10:22:55.702643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-79157a02-c78e-4e1c-b18e-32f55281d209 req-f15b6b20-cd54-4265-9cb6-a1b36d68addd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069587 Jun 15 10:22:55.704208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 106/209] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:22:55.756114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:55.756714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:55.763084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.763515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.764486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:55.765098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:55.908508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.917047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.918547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:55.919679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c682a170-bfc0-4940-a0a0-76551939257a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.167425 Jun 15 10:22:55.920234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 104/210] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:56.137487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:56.138209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:56.145829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.146268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:56.147031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.147451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:56.326010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:56.334453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11d2bc8f-68de-4cc9-830a-e40f1edf2456 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.201138 Jun 15 10:22:56.335084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 107/211] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:56.662695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:56.664323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:56.678238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.679342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:56.681357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.682544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:56.887960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:56.900332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1c66a3b-1a2f-451c-97d3-39e16e8a4332 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.244950 Jun 15 10:22:56.911767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 105/212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:56 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:56.942879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:56.943617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:56.949796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.950243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:56.951014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:56.951449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.191912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.204060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.204060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.204060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cef83d13-cda9-4f0b-ba01-414a9a112d6b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1407 microversion: 2.20 time: 0.265476 Jun 15 10:22:57.205595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 108/213] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:22:57.353513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:57.354253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:57.362304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.362924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.364022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.364794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.517745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:57.526460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8429aae-f0e5-43d1-a36c-0082294a93d0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.178629 Jun 15 10:22:57.538933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 106/214] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:57.917526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:57.918139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:57.928842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.929490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:57.930521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:57.931162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.237730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:58.239219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:58.282975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.290040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.293254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.293952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.388611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.399093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b689f99-a5ba-49cb-a0f4-4f9cee2a6b41 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.484347 Jun 15 10:22:58.399983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 109/215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:57 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:58.547154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:58.548511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:58.558508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.558954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.559936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.560411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.646402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.655051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.658098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.659556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf03d44e-324a-4d22-a04e-1ea1089cf067 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1598 microversion: 2.20 time: 0.438329 Jun 15 10:22:58.671496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 107/216] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:22:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1598 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:22:58.685236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:58.685983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:58.693933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.694858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.695797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:58.696503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:58.818881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:58.819041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f17f8366-a022-45c6-88c6-30bc87adfbb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.139542 Jun 15 10:22:58.820799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 108/217] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Jun 15 10:22:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:58.827860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6b638fe-afcd-4b02-bcfd-fd280b6f5178 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.286485 Jun 15 10:22:58.828497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 110/218] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:59.418327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:59.418966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:59.425408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.425853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.426631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.427060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.751930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:22:59.755723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:59.760564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6af12f5-21f7-400a-b67f-e27de1ef6013 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.346761 Jun 15 10:22:59.761231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 109/219] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:59 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:59.850222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:59.851209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:22:59.857597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.858390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:59.859204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:59.859628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.034804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:00.046081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-211aaa5c-6e54-461f-8ebb-2757de55af83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.201645 Jun 15 10:23:00.046919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 111/220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:22:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:00.104368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e584a1c5-be63-415b-823f-fe32800c62be req-060bb26f-1e6f-420f-9cc8-b56f9c016466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:00.115345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e584a1c5-be63-415b-823f-fe32800c62be req-060bb26f-1e6f-420f-9cc8-b56f9c016466 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.116017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e584a1c5-be63-415b-823f-fe32800c62be req-060bb26f-1e6f-420f-9cc8-b56f9c016466 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.127812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e584a1c5-be63-415b-823f-fe32800c62be req-060bb26f-1e6f-420f-9cc8-b56f9c016466 service nova] Creating event network-changed:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:23:00.133073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e584a1c5-be63-415b-823f-fe32800c62be req-060bb26f-1e6f-420f-9cc8-b56f9c016466 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033307 Jun 15 10:23:00.134234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 110/221] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:00.779420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:00.779954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:00.790549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.791006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:00.791804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:00.792230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.020616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:01.031526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-46de75f8-707b-469b-8213-dd33121127ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.257494 Jun 15 10:23:01.035287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:00 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:01.070820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:01.073075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:01.080986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.084210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.084210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:01.084210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:01.577959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:01.591199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8536b069-3ee9-4118-b2b0-471e851c81a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1362 microversion: 2.1 time: 0.528964 Jun 15 10:23:01.592781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 111/223] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:02.049683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:02.050291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:02.061029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.061658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.062766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.063582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.205408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:02.213537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-813e3a7e-fbec-47d6-90a2-b31c3f543cf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.168388 Jun 15 10:23:02.214034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 113/224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:02 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:02.609939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:02.610667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:02.617247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.617701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.618657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.619087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.767099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:02.775895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43b69b80-94ca-41c0-8445-2aa98c54b23f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1548 microversion: 2.1 time: 0.170616 Jun 15 10:23:02.776532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 112/225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:02.793761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:02.794630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:02.804666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.805179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.809336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:02.809336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:02.932131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2eefc3c-48ec-4688-ba45-c28389af406d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142090 Jun 15 10:23:02.939891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 114/226] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:23:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:03.231782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:03.232650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:03.240511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.241187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.242152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.242591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.452016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:03.462957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87cda74d-4d9f-4387-9b69-95d1d4c48f37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.233260 Jun 15 10:23:03.463578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 113/227] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:03 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:03.473320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:03.473320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:03.476641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.477593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.479134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.480009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.525187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:03.546501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:23:03.939636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba1d5b33-c0e4-4560-9c2e-0ca44b34bfc2 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 204 len: 0 microversion: 2.1 time: 0.474992 Jun 15 10:23:03.940452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 115/228] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:23:03 2022] DELETE /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:23:03.949686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:03.950477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:03.958348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.959061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:03.959974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:03.960511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.130872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:04.137028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c72e2b0b-7a15-449c-874b-66fae3ddc256 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1554 microversion: 2.1 time: 0.191513 Jun 15 10:23:04.137693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 114/229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:03 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:04.481218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:04.482054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:04.489130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.489670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.490548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.500300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.671816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:04.680216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eab8d3b0-ba66-481f-bbc3-b4e2309c9546 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.203238 Jun 15 10:23:04.680779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 116/230] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:04 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:04.827633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-06a92eae-85c2-48ac-8e2a-3093bf629f57 req-428edbfa-0ca0-487e-a500-c90a32ef516e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a5478-7be1-4af4-913f-48a2c5ee7199", "tag": "b7da9a2f-05fc-414c-ae2d-5271d90eaedb"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:04.843280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-06a92eae-85c2-48ac-8e2a-3093bf629f57 req-428edbfa-0ca0-487e-a500-c90a32ef516e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:04.844272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-06a92eae-85c2-48ac-8e2a-3093bf629f57 req-428edbfa-0ca0-487e-a500-c90a32ef516e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:04.857768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-06a92eae-85c2-48ac-8e2a-3093bf629f57 req-428edbfa-0ca0-487e-a500-c90a32ef516e service nova] Creating event network-changed:b7da9a2f-05fc-414c-ae2d-5271d90eaedb for instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 on hv-cinder-84580 Jun 15 10:23:04.870428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-06a92eae-85c2-48ac-8e2a-3093bf629f57 req-428edbfa-0ca0-487e-a500-c90a32ef516e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046254 Jun 15 10:23:04.871215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 115/231] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:05.021520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2027334727", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "networks": [{"uuid": "a3c01846-8a83-47b1-9fce-3ebfc1b99471"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:05.092729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] validate_networks() for [('a3c01846-8a83-47b1-9fce-3ebfc1b99471', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:23:05.160059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:05.160847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:05.170638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.171107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.171915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.173746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.396277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.407637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db5cd945-9a53-4593-8dc1-c393890eb51d tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1554 microversion: 2.1 time: 0.254770 Jun 15 10:23:05.409143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 116/232] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:05 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:05.601580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:23:05.602401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:23:05.603062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:23:05.603532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:23:05.603949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:23:05.615481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.616222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.617239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.617696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.642516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Getting quotas for project e73242c46698496ba8b80ce681417938. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:23:05.648813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Getting quotas for user 1d4be529ee5e4765ada8eaee33e21c64 and project e73242c46698496ba8b80ce681417938. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:23:05.651799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:05.664234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:23:05.666986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:23:05.701185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:05.701788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:05.708659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.709295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.710411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:05.711012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:05.822125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86fa39d7-16d9-47a5-8353-cec663b51c56 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805953 Jun 15 10:23:05.838073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 117/233] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:23:05.848136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a95e9d6-a380-4bfb-bd19-e0ed482c92b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:05.849092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a95e9d6-a380-4bfb-bd19-e0ed482c92b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:05.909915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.921515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ecd62380-f68d-46d1-9a70-4518a68fb318 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.225911 Jun 15 10:23:05.954368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 117/234] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:05 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:05.970943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a95e9d6-a380-4bfb-bd19-e0ed482c92b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:05.978972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a95e9d6-a380-4bfb-bd19-e0ed482c92b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1214 microversion: 2.1 time: 0.139577 Jun 15 10:23:05.989868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 118/235] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:05 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:06.425569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:06.426124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:06.436683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.437746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.439435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.440130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.607521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:06.607521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36933353-6a70-4f12-a010-fb01aabc4288 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1554 microversion: 2.1 time: 0.183810 Jun 15 10:23:06.607521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 118/236] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:06 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:06.943247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:06.944091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:06.952535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.953080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.953940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:06.955588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:06.996232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45c592a6-c688-4a28-81e2-197495761596 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:06.998704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45c592a6-c688-4a28-81e2-197495761596 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.080032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-45c592a6-c688-4a28-81e2-197495761596 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.087255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45c592a6-c688-4a28-81e2-197495761596 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1214 microversion: 2.1 time: 0.095497 Jun 15 10:23:07.087859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 119/237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:06 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:07.333510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.342240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee9d795c-9cb9-4b78-9c04-fc3a75b5fb9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.403432 Jun 15 10:23:07.343258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:06 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:07.623685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:07.624401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:07.628641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:07.633667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.634121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.635081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.635516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.713117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:07.719367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-01f3327d-fc34-40f3-b481-5f23c6a18b0c req-1cd1d599-69ed-4efa-b896-c79d00f896d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36d5f4f7-99d7-4850-9719-aad011589217", "name": "network-vif-deleted", "tag": "0c64e3fd-8b7d-4790-90b8-b06051a70d29"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:07.722386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-577e77f8-e3ac-4dde-87b2-affd3c668dbc tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1512 microversion: 2.1 time: 0.102815 Jun 15 10:23:07.722966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 120/239] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:07 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:07.727608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-01f3327d-fc34-40f3-b481-5f23c6a18b0c req-1cd1d599-69ed-4efa-b896-c79d00f896d0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:07.728040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-01f3327d-fc34-40f3-b481-5f23c6a18b0c req-1cd1d599-69ed-4efa-b896-c79d00f896d0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:07.741952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-01f3327d-fc34-40f3-b481-5f23c6a18b0c req-1cd1d599-69ed-4efa-b896-c79d00f896d0 service nova] Creating event network-vif-deleted:0c64e3fd-8b7d-4790-90b8-b06051a70d29 for instance 36d5f4f7-99d7-4850-9719-aad011589217 on hv-cinder-84580 Jun 15 10:23:07.746824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-01f3327d-fc34-40f3-b481-5f23c6a18b0c req-1cd1d599-69ed-4efa-b896-c79d00f896d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Jun 15 10:23:07.747412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 120/240] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:23:08.105302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.105911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.112902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.113383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.114153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.114590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.179616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.187530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-26d7a288-80dc-426c-a115-266055d50935 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1266 microversion: 2.1 time: 0.086046 Jun 15 10:23:08.188748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 121/241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:08.362814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.363515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.370424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.370545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.371231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.371647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.511230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.521480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8965eb8b-17d6-413d-936b-441086479598 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.163489 Jun 15 10:23:08.522054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 121/242] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:08.740160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:08.741086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:08.748162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.748601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.752200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.752200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.783946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:08.784430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:08.784883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lazy-loading 'fault' on Instance uuid 36d5f4f7-99d7-4850-9719-aad011589217 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:08.834343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f8028df66d44c478268a84167c9ff19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8e3aa03dcf4c5a989a604548e9c4ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:08.848527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8d72b5f-826c-4b6d-9b56-3f842c47581e tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 200 len: 1350 microversion: 2.1 time: 0.112223 Jun 15 10:23:08.849149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 122/243] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:08 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:09.212907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.214258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.229491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.232501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.233569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.234212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.320782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.329013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b0647a50-9415-4ff3-9b6d-42b741f19983 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1272 microversion: 2.1 time: 0.125902 Jun 15 10:23:09.329575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 122/244] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:09.552440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.553131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.560574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.561055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.561903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.562270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.708793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:09.716660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f87adc8-9b87-485f-96af-620d54442082 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.180841 Jun 15 10:23:09.717276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 123/245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:09.866708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:09.867260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:09.874832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.876154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.877582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:09.878214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:09.895494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] HTTP exception thrown: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Request method failure captured: Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 HTTP/1.1 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbK5rOup80wNZI9GEC_BesL_Ko5s71MyXBto60qOxzPbgIMaFnDmN0JIP6rH1r2kh-AmSzt2zsAJ4NFY9-wKk8UXJx0VuQ0DsbYXvlW3g5-wQSfZ4xOw04ePmEHSwKhLvu4MK7IT-Os15WDdx-X7lvo4hpKaWAmZxnChTL6t0YwF654 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:23:09.900263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0b8e3aa03dcf4c5a989a604548e9c4ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 3f8028df66d44c478268a84167c9ff19 Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:09.902079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '36d5f4f7-99d7-4850-9719-aad011589217'} Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:09.902830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:09.903929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:09.904910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Returning 404 to user: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:09.904910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d89efc6a-3fb2-485b-ab2e-19c3a023cda6 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 404 len: 111 microversion: 2.1 time: 0.039681 Jun 15 10:23:09.904910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 123/246] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:09 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:10.021017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.022108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.029226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.029673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.030452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.030921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.044752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] HTTP exception thrown: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Request method failure captured: Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217/os-volume_attachments HTTP/1.1 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbK5rOup80wNZI9GEC_BesL_Ko5s71MyXBto60qOxzPbgIMaFnDmN0JIP6rH1r2kh-AmSzt2zsAJ4NFY9-wKk8UXJx0VuQ0DsbYXvlW3g5-wQSfZ4xOw04ePmEHSwKhLvu4MK7IT-Os15WDdx-X7lvo4hpKaWAmZxnChTL6t0YwF654 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:23:10.049375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0b8e3aa03dcf4c5a989a604548e9c4ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 3f8028df66d44c478268a84167c9ff19 Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:10.050568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '36d5f4f7-99d7-4850-9719-aad011589217'} Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:10.051190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:10.053179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:10.056274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Returning 404 to user: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:10.056274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87e18540-b80b-4071-bf58-3793130917ba tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034939 Jun 15 10:23:10.056274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 124/247] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:10.347386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.347998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.356050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.356050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.357964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.358661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.589044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:10.597413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b05fc923-28b9-4dac-97de-dafa8b8d1551 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.254251 Jun 15 10:23:10.597981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 124/248] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:10.735949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:10.736755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:10.744158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.744763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.745729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.746162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.785066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-41d0bbb0-8d9b-484b-a79a-f97a5fb8cc19 req-c9bd790c-a72b-43f6-94cb-f66a64622359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bec89ed-c700-4221-b9ee-d7ee1747a31a", "tag": "f12735ff-4ff0-4124-bb46-163947b2ee85"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:10.809766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-41d0bbb0-8d9b-484b-a79a-f97a5fb8cc19 req-c9bd790c-a72b-43f6-94cb-f66a64622359 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:10.810519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-41d0bbb0-8d9b-484b-a79a-f97a5fb8cc19 req-c9bd790c-a72b-43f6-94cb-f66a64622359 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:10.831310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-41d0bbb0-8d9b-484b-a79a-f97a5fb8cc19 req-c9bd790c-a72b-43f6-94cb-f66a64622359 service nova] Creating event network-changed:f12735ff-4ff0-4124-bb46-163947b2ee85 for instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a on hv-cinder-84580 Jun 15 10:23:10.837069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-41d0bbb0-8d9b-484b-a79a-f97a5fb8cc19 req-c9bd790c-a72b-43f6-94cb-f66a64622359 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056123 Jun 15 10:23:10.837705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 125/249] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:23:10.891735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:10.899587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2bcf235a-310a-41f7-99d6-0b8d62b7fdea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.169393 Jun 15 10:23:10.900201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 125/250] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:10 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:11.451961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:11.452572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:11.460733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.461804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.463038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.468678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.490510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] HTTP exception thrown: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Request method failure captured: Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 HTTP/1.1 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbK5rOup80wNZI9GEC_BesL_Ko5s71MyXBto60qOxzPbgIMaFnDmN0JIP6rH1r2kh-AmSzt2zsAJ4NFY9-wKk8UXJx0VuQ0DsbYXvlW3g5-wQSfZ4xOw04ePmEHSwKhLvu4MK7IT-Os15WDdx-X7lvo4hpKaWAmZxnChTL6t0YwF654 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:23:11.492645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0b8e3aa03dcf4c5a989a604548e9c4ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 3f8028df66d44c478268a84167c9ff19 Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.494148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '36d5f4f7-99d7-4850-9719-aad011589217'} Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:11.494909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.496041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.498635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Returning 404 to user: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:11.499526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0beedb36-049f-4174-a32a-dd8e22cfbe06 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "DELETE /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 404 len: 111 microversion: 2.1 time: 0.052003 Jun 15 10:23:11.500094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 126/251] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:23:11 2022] DELETE /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:11.509124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:11.509807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] [instance: 36d5f4f7-99d7-4850-9719-aad011589217] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:11.516573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.517144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.517976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.518476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.533650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] HTTP exception thrown: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Request method failure captured: Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 HTTP/1.1 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbK5rOup80wNZI9GEC_BesL_Ko5s71MyXBto60qOxzPbgIMaFnDmN0JIP6rH1r2kh-AmSzt2zsAJ4NFY9-wKk8UXJx0VuQ0DsbYXvlW3g5-wQSfZ4xOw04ePmEHSwKhLvu4MK7IT-Os15WDdx-X7lvo4hpKaWAmZxnChTL6t0YwF654 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:23:11.535927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0b8e3aa03dcf4c5a989a604548e9c4ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0b8e3aa03dcf4c5a989a604548e9c4ba", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 0b8e3aa03dcf4c5a989a604548e9c4ba Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-DeleteServersTestJSON-88794829 Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 3f8028df66d44c478268a84167c9ff19 Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-DeleteServersTestJSON-88794829-project Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.537344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '36d5f4f7-99d7-4850-9719-aad011589217'} Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:11.537971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. Jun 15 10:23:11.542166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:11.543168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] Returning 404 to user: Instance 36d5f4f7-99d7-4850-9719-aad011589217 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:11.543168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-91b1a5f3-8b4e-4d30-8f2b-1e4ddac5c7f8 tempest-DeleteServersTestJSON-88794829 tempest-DeleteServersTestJSON-88794829-project] 10.222.0.60 "GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217" status: 404 len: 111 microversion: 2.1 time: 0.032481 Jun 15 10:23:11.543168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 126/252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:11 2022] GET /compute/v2.1/servers/36d5f4f7-99d7-4850-9719-aad011589217 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:23:11.615644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:11.616620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:11.622886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.623714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.624486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.624914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.919851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:11.920595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:11.927534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.927971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.928900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:11.929503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:11.940713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:11.949072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5813a7a8-a4c9-4e03-8b2c-6a7444173ede tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.337569 Jun 15 10:23:11.960428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 127/253] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:11 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:12.112251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:12.122132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f38eaa4e-4517-4eee-8fe4-414dfe3f41a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.204885 Jun 15 10:23:12.122132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 127/254] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:11 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:12.967013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:12.967632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:12.978098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.979935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:12.979935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:12.979935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.139822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:13.141474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:13.148664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.149243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.150078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:13.150627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:13.199247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.207291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c4d64b1-2b74-4c24-9f76-b0840c81a8dd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.244158 Jun 15 10:23:13.208104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 128/255] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:12 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:13.313013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:13.323273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8485df90-d375-49ec-b847-5e9a92e7c471 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.188630 Jun 15 10:23:13.324185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 128/256] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:13 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:14.223714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:14.224993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:14.232136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.232612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.233411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.233983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.346970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:14.347639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:14.360235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.360235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.360235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:14.360235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:14.403717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:14.412981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9dbd4ec-e9ce-4a0d-a08d-bb4e883cf211 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.193297 Jun 15 10:23:14.413567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 129/257] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:14 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:14.514188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:14.517669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:14.522123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-72cbe8e2-3dfa-4fdd-baf0-8e5ebb337faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.183939 Jun 15 10:23:14.522692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 129/258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:14 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:15.429766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:15.430413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:15.436863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.437361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.438128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.439166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.540519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:15.541752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:15.552336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.553127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.554115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:15.554689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:15.607399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.617557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-823a1369-484a-493e-89da-39296713972b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.191494 Jun 15 10:23:15.628599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 130/259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:15 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:15.722713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:15.730320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c9aad1b-7b64-4f1b-bdba-687d310fcf89 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.194176 Jun 15 10:23:15.730868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 130/260] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:15 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:16.637519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:16.638208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:16.643479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:16.644864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:16.650498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.652332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.653491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.654379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.747771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:16.748388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:16.761328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.761928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.762735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:16.763174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:16.818573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.828028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5eb84f94-1e2d-4258-b2d3-b8d4942663d4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.194994 Jun 15 10:23:16.829842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 131/261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:16 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:16.932293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:16.941328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6db3aded-4aeb-4f39-8d71-b72df3a87502 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.197322 Jun 15 10:23:16.941904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 131/262] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:16 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:17.821719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-1c09a4cf-f1b5-4af2-9d82-b6c54f5bcfe5 req-0651398f-b92e-4299-9c19-c7a6aeef2992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec89ed-c700-4221-b9ee-d7ee1747a31a", "name": "network-vif-plugged", "status": "completed", "tag": "f12735ff-4ff0-4124-bb46-163947b2ee85"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:17.830783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-1c09a4cf-f1b5-4af2-9d82-b6c54f5bcfe5 req-0651398f-b92e-4299-9c19-c7a6aeef2992 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.831228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-1c09a4cf-f1b5-4af2-9d82-b6c54f5bcfe5 req-0651398f-b92e-4299-9c19-c7a6aeef2992 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.843102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-1c09a4cf-f1b5-4af2-9d82-b6c54f5bcfe5 req-0651398f-b92e-4299-9c19-c7a6aeef2992 service nova] Creating event network-vif-plugged:f12735ff-4ff0-4124-bb46-163947b2ee85 for instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a on hv-cinder-84580 Jun 15 10:23:17.846706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:17.847895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:17.850552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-1c09a4cf-f1b5-4af2-9d82-b6c54f5bcfe5 req-0651398f-b92e-4299-9c19-c7a6aeef2992 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Jun 15 10:23:17.850552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 132/263] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:17.850756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:17.856371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.856759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.857805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.858107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.962344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:17.963738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:17.971780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.972219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:17.973011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:17.974082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:18.008756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:18.017262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f127821e-9e59-4715-bb7b-52980491c9b3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.174607 Jun 15 10:23:18.018127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 132/264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:17 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:18.114338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:18.122294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7fa6414-f44b-41ce-83e3-7c8edcc887ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.164182 Jun 15 10:23:18.122865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 133/265] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:17 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:19.035212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:19.035729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:19.042900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:19.043426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:19.044192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:19.044619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:19.139692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:19.140310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:19.146723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:19.147172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:19.147945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:19.148371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:19.194342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.203781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-63d80dc8-057c-47ab-a8e2-90610b51f394 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.173201 Jun 15 10:23:19.205191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 133/266] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:19 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:19.431860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:19.439992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b22b6a8f-d174-4c1a-be3a-b7ccbdc4cd6b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.304111 Jun 15 10:23:19.449823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 134/267] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:19 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:20.222896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:20.223502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:20.230095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.230535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.231294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.231722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.364593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.372086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4929c24-4941-465a-9e80-8058fb118273 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.153420 Jun 15 10:23:20.372670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 134/268] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:20 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:20.458194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:20.458800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:20.465165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.465608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.466366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:20.466835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:20.485714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:20.610087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:20.618381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8850f3c0-6a41-490f-be25-38cd92436258 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.164670 Jun 15 10:23:20.618942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 135/269] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:20 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:21.389967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:21.390481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:21.398621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.399085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.399908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.400648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.536213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:21.544097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-483af9a8-92d3-4cc9-9b8c-3b7423544186 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.157943 Jun 15 10:23:21.544664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 135/270] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:21 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:21.635926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:21.636563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:21.643428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.643804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.644565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:21.645008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:21.776700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:21.784887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9ef85ef-8b48-4ad5-a07d-3f7c00421f3f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.152728 Jun 15 10:23:21.785478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 136/271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:21 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:22.561796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:22.562396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:22.569807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.570244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.571017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.571444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.712692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:22.720892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b22e540-14c5-4a97-a5f3-30bb1630c1cc tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.162678 Jun 15 10:23:22.721511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 136/272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:22 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:22.801973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:22.802575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:22.808655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.809143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.811961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:22.811961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:22.945017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:22.952563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6873e95-1518-44f6-9367-3173c9a71b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.154562 Jun 15 10:23:22.953264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:22 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:23.793290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:23.793290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:23.793290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:23.793290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:23.794238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:23.794238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:23.880331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:23.889109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b4fcaed-e880-4453-bb81-480feb91476b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.155635 Jun 15 10:23:23.925232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 137/274] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:23 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:23.971088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:23.971729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:23.978195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:23.978638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:23.979415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:23.979944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:24.119303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:24.130069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0aa2457-1424-4a30-b458-7ef7b625e0fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.161853 Jun 15 10:23:24.130069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 138/275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:23 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:24.931755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:24.932361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:24.939542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:24.939976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:24.940724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:24.941190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:25.072921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:25.081759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92926624-c947-43ed-8751-21a3c8a55d28 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1314 microversion: 2.1 time: 0.153797 Jun 15 10:23:25.082341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 138/276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:24 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:25.145941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:25.146541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:25.153175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:25.153606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:25.154359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:25.155108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:25.305918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:25.314514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a1fba15-7354-47ad-9461-406fc8220db6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.172565 Jun 15 10:23:25.318476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 139/277] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:25 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:26.102771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:26.103373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:26.110004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.111859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:26.111972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.112376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:26.253764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:26.261774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c5099ca3-ec2d-4e1a-8e51-beea75985c78 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1498 microversion: 2.1 time: 0.163057 Jun 15 10:23:26.262333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 139/278] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:26 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:26.332235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:26.332877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:26.338996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.341220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:26.341220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:26.341220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:26.479393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:26.488156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19d6b5ff-cd89-4df9-8c0a-2f087de0f62f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.160285 Jun 15 10:23:26.488987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 140/279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:26 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:27.506027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:27.509171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:27.515575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:27.516296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:27.518129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:27.518734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:27.663393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:27.669486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9cb30a1-5a1c-4d2d-983f-b414e849992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.168036 Jun 15 10:23:27.670078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 140/280] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:27 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:28.687654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:28.688254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:28.695006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:28.695457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:28.696292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:28.696739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:28.836397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:28.842131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-37a99808-a6ae-4ae6-95d8-626fd6e280c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.158252 Jun 15 10:23:28.842707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 141/281] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:28 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:29.859451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:29.860062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:29.867893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:29.868266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:29.869088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:29.869530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:30.013825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:30.021722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1b2c8b6-0154-457e-9309-ec786817d98e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.166329 Jun 15 10:23:30.026119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 141/282] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:29 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:31.038655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:31.039297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:31.049165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:31.049165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:31.049165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:31.049165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:31.185902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:31.194934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f114a37-56b3-49c5-9a37-cdbbecd498d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.160020 Jun 15 10:23:31.195563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 142/283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:31 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:32.216517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:32.219515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:32.228425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.229375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.230427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:32.230863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:32.377344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:32.384881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76fd5ed2-5e4f-440e-a1b8-3015ddd40dc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.172975 Jun 15 10:23:32.385699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 142/284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:32 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:33.402956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:33.406067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:33.412901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:33.413369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:33.414138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:33.414566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:33.555669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:33.563327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-54f7e4d8-9693-42d5-ac51-55850a59f663 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.164567 Jun 15 10:23:33.563895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 143/285] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:33 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:34.581700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:34.582467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:34.589215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.590656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.590656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:34.591055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:34.738344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:34.747709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93ca61c2-8520-4c44-a296-594aa5b187d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.171063 Jun 15 10:23:34.748349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 143/286] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:34 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:35.365195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:35.366141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:35.372146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.372638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.375521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.375521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.401029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:23:35.706252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9293eabd-92b2-4a2a-92b0-eaf68ff58757 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 204 len: 0 microversion: 2.1 time: 0.343718 Jun 15 10:23:35.706948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 144/287] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:23:35 2022] DELETE /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:23:35.715291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:35.715900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:35.723293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.723738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.724561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.725011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.765885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:35.766660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:35.773995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.774859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.775913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:35.776343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:35.879476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:35.887714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92764055-a3e9-4cc8-b84b-12ce5f1e3da9 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.176183 Jun 15 10:23:35.888605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:35 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:35.922316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:35.931423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84e6aace-a8c9-44ec-abec-0404f217c5c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.169657 Jun 15 10:23:35.932078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 145/289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:35 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:36.905253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:36.906570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:36.914447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.914892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.915673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.916147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.948736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:36.950147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:36.952369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:36.959223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.962175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:36.963164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:36.963618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:37.053811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:37.061418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ba3be1e-7ed7-4444-be80-e94aa504a7ae tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.160008 Jun 15 10:23:37.061983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 145/290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:36 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:37.100823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:37.109141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab7d3a29-3d7a-4d6e-8dc5-44d7d5f2ad2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.164530 Jun 15 10:23:37.109714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 146/291] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:36 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:38.083287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:38.084034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:38.087602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=53 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.093178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.094824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.094824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.095192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.114349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.126296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:38.127540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:38.133815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.134295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.135015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:38.135440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:38.241037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.248939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-59441e8e-c621-457d-b0d8-42fc91a09adb tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.170186 Jun 15 10:23:38.249827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:38 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:38.286653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:38.294476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-96d603c9-3fe3-40f8-af6c-64d6f21122f4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.172331 Jun 15 10:23:38.295042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 147/293] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:38 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:39.265522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:39.266115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:39.272675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.273155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.273916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.274360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.311625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:39.312308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:39.319496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.319945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.320724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:39.321189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:39.409304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.418335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-efe724c6-5b11-4650-b528-652c4bbbc7ac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.156710 Jun 15 10:23:39.418907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 147/294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:39 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:39.460598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:39.468273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c6d0909-4abd-47eb-a936-24dc92dc5cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.160588 Jun 15 10:23:39.468820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 148/295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:39 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:40.436003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:40.436617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:40.444675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.445146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.445922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.446349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.488139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:40.488861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:40.511786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.511786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.511786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:40.511786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:40.598803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.607053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edc32b10-6ad3-47fb-96f6-00089810d7b2 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.174907 Jun 15 10:23:40.607943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 148/296] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:40 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:40.649698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:40.657313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cdea9c97-4fce-49f7-9a1d-b6b5f921e726 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.175876 Jun 15 10:23:40.658427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 149/297] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:40 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:41.626104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:41.626829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:41.634127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.634557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.635317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.635745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.676250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:41.677161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:41.683381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.684081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.684861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:41.685345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:41.706662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:41.784070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.796661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-514e5520-6441-48f8-921a-3388e4158fdd tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.169992 Jun 15 10:23:41.796661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 149/298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:41 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:41.836889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:41.844433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddff8689-8a06-4ec3-ba66-89c16edbab23 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.173142 Jun 15 10:23:41.845041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 150/299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:41 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:42.810001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:42.810712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:42.818235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.818683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.819716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.820286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.862665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:42.863353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:42.870994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.871443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.872228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:42.872690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:42.971619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:42.979733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-788a52e3-4dad-4d0d-9056-6cc3c4db0dec tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.173381 Jun 15 10:23:42.980147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 150/300] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:42 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:43.035871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:43.043767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21d366c6-2b6c-4e03-b57d-f62371ed9ee4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.184990 Jun 15 10:23:43.044512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 151/301] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:42 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:43.996423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:43.997045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:44.003835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.004272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.005098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.005523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.061016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:44.061631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:44.068696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.069422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.070198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:44.070635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:44.165872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:44.177451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4b5fa4b-f3b1-4da7-a376-57cffd2f999a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.184935 Jun 15 10:23:44.183019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 151/302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:43 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:44.225702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:44.233411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4f91dc1-8383-4eb9-8caa-60e09ccddb95 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.176185 Jun 15 10:23:44.233980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 152/303] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:44 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:45.195167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:45.195761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:45.202424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.202866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.203662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.204099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.250936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:45.251550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:45.258295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.258740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.259515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:45.259953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:45.364728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.372603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5dab309-fb7d-4ace-a425-94c8407d6a11 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1504 microversion: 2.1 time: 0.181521 Jun 15 10:23:45.373302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 152/304] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:45 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:45.421900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:45.430618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b6bc2ec-d826-4724-a33c-fa7aa1fc66d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.183626 Jun 15 10:23:45.431250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 153/305] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:45 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:46.028812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-0bea337f-2cc8-48f5-86a9-2ddcf3bc985a req-118a086b-b11b-4bdd-ae40-589e6c12c77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bec89ed-c700-4221-b9ee-d7ee1747a31a", "name": "network-vif-deleted", "tag": "f12735ff-4ff0-4124-bb46-163947b2ee85"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:46.037254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0bea337f-2cc8-48f5-86a9-2ddcf3bc985a req-118a086b-b11b-4bdd-ae40-589e6c12c77e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.037694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0bea337f-2cc8-48f5-86a9-2ddcf3bc985a req-118a086b-b11b-4bdd-ae40-589e6c12c77e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.050071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-0bea337f-2cc8-48f5-86a9-2ddcf3bc985a req-118a086b-b11b-4bdd-ae40-589e6c12c77e service nova] Creating event network-vif-deleted:f12735ff-4ff0-4124-bb46-163947b2ee85 for instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a on hv-cinder-84580 Jun 15 10:23:46.055883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-0bea337f-2cc8-48f5-86a9-2ddcf3bc985a req-118a086b-b11b-4bdd-ae40-589e6c12c77e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030032 Jun 15 10:23:46.055883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 153/306] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:46.389689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:46.390355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:46.397422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.397613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.398391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.401820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.449432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:46.450823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:46.458359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.459731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.459731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:46.460276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:46.465718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.477079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-674f14bf-238b-4f37-bdc6-ce56fb6aabc0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1462 microversion: 2.1 time: 0.091140 Jun 15 10:23:46.477681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 154/307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:46 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1462 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:46.609177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:46.618512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f30054f2-258c-4f6a-855f-6ac03fef7e37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1519 microversion: 2.1 time: 0.173985 Jun 15 10:23:46.619346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 154/308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:46 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:23:47.496353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:47.497029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:47.504561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.505096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.506065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.506450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.540058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.540576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.540985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lazy-loading 'fault' on Instance uuid 4bec89ed-c700-4221-b9ee-d7ee1747a31a {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:47.586754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.594770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5ea061a-ae60-4592-9593-3fb570f21976 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 200 len: 1304 microversion: 2.1 time: 0.103568 Jun 15 10:23:47.595392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 155/309] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:47 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:47.637551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:47.638190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:47.645628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.646053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.646868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.647308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.803534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:47.815088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b19f6c3-29eb-4154-8a56-38e2e86a64f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1499 microversion: 2.1 time: 0.180842 Jun 15 10:23:47.816006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 155/310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:47 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1499 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:47.836192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:47.838838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:47.845351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.845961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:47.846631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:47.847064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.000576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:48.009211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1f59a0c-2050-4b2c-b807-7ca6e711946f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1512 microversion: 2.1 time: 0.177506 Jun 15 10:23:48.009785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 156/311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:47 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:48.619279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:48.620083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: 4bec89ed-c700-4221-b9ee-d7ee1747a31a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:48.626505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.627252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.628241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:48.628885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:48.645298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] HTTP exception thrown: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Request method failure captured: Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a HTTP/1.1 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbMFq-_iZJA_OsJ5pTt8cAutO85YzIJ_EglhkFk9ZedE-_QAu3io0jWVMEANNG3ZFoFEMRJ79AmkGmEyjKY1owvb29-urXvFa5ikI4Q-g1THqYOMT2337c2KV1U5gxcAxhbpp5r-hMLa0XCBcZY1Mpd8MSN2j05defoFmRslyHn9L9U Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: e73242c46698496ba8b80ce681417938 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesActionsTest-2113882905 Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:23:48.647072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e73242c46698496ba8b80ce681417938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e73242c46698496ba8b80ce681417938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e73242c46698496ba8b80ce681417938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e73242c46698496ba8b80ce681417938", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesActionsTest-2113882905 Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: e73242c46698496ba8b80ce681417938 Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesActionsTest-2113882905 Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesActionsTest-2113882905-project Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 1d4be529ee5e4765ada8eaee33e21c64 Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesActionsTest-2113882905-project Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. Jun 15 10:23:48.648339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '4bec89ed-c700-4221-b9ee-d7ee1747a31a'} Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:23:48.649097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. Jun 15 10:23:48.650502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:23:48.651515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Returning 404 to user: Instance 4bec89ed-c700-4221-b9ee-d7ee1747a31a could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:23:48.651515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4e6fbc57-4c6a-4c19-83da-e8331042811a tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a" status: 404 len: 111 microversion: 2.1 time: 0.033152 Jun 15 10:23:48.651515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 156/312] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:48 2022] GET /compute/v2.1/servers/4bec89ed-c700-4221-b9ee-d7ee1747a31a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:23:48.777165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-345085", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "networks": [{"uuid": "a3c01846-8a83-47b1-9fce-3ebfc1b99471"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:48.839117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] validate_networks() for [('a3c01846-8a83-47b1-9fce-3ebfc1b99471', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:23:49.349936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:23:49.350389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:23:49.351132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:23:49.351592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:23:49.351691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:23:49.360874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.362067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:49.362856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:49.363292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:49.389312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Getting quotas for project e73242c46698496ba8b80ce681417938. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:23:49.394368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Getting quotas for user 1d4be529ee5e4765ada8eaee33e21c64 and project e73242c46698496ba8b80ce681417938. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:23:49.406500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:23:49.408824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:23:49.529822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc1307ab-5f46-49a6-aaba-1e2d1a2d9362 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756542 Jun 15 10:23:49.530658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 157/313] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:23:49.540815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f604ffa-6280-494c-b6fc-67b562f11584 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:49.541796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f604ffa-6280-494c-b6fc-67b562f11584 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:49.616681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f604ffa-6280-494c-b6fc-67b562f11584 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:49.625157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f604ffa-6280-494c-b6fc-67b562f11584 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1210 microversion: 2.1 time: 0.088197 Jun 15 10:23:49.634970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 157/314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:49 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:50.643636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:50.644305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:50.650408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:50.650877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:50.651648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:50.652085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:50.722940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:50.730235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-060ab961-144d-41ee-ab42-36fb05439b04 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1214 microversion: 2.1 time: 0.091370 Jun 15 10:23:50.730800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 158/315] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:50 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:51.748837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:51.749474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:51.757236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.757680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.758478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:51.758874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:51.822140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:51.829666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf371fe4-69b2-4ac7-a136-a827a6ff9418 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1214 microversion: 2.1 time: 0.084802 Jun 15 10:23:51.830959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 158/316] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:51 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:52.848019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:52.848626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:52.854826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.855264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.856013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:52.856441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:52.917997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:52.926009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c2c409c-3b41-42fb-81ce-226d9d99a331 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1214 microversion: 2.1 time: 0.082417 Jun 15 10:23:52.926569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 159/317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:52 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:53.943710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:53.944611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:53.952304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.952979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:53.960216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:53.960216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:54.017919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:54.026396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ee31548-8f7d-4f6a-88d5-49d94cfa73a3 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1262 microversion: 2.1 time: 0.087417 Jun 15 10:23:54.026973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 159/318] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:53 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:55.047614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:55.048217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:55.060093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:55.060093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:55.060093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:55.060093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:55.247485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:55.256649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-007cf655-4d52-4e3a-bacb-c44b8c116e12 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1280 microversion: 2.1 time: 0.216590 Jun 15 10:23:55.257265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 160/319] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:55 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:56.274404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:56.274998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:56.281727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.282166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.282918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.283342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.419340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:56.428758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-044f5006-7e40-4331-acef-8040a096883c tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.158183 Jun 15 10:23:56.429355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 160/320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:56 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:56.878321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-e7c28494-c64f-480b-ae62-16519e1fef57 req-13c4775d-7c30-4358-8b45-e20f4b3d9267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28c8f62-27b3-463a-8718-a5447816ed7c", "tag": "b1b50c85-4cf7-4927-857c-e6d0fb5df6ab"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:56.889023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e7c28494-c64f-480b-ae62-16519e1fef57 req-13c4775d-7c30-4358-8b45-e20f4b3d9267 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:56.889375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e7c28494-c64f-480b-ae62-16519e1fef57 req-13c4775d-7c30-4358-8b45-e20f4b3d9267 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:56.906029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-e7c28494-c64f-480b-ae62-16519e1fef57 req-13c4775d-7c30-4358-8b45-e20f4b3d9267 service nova] Creating event network-changed:b1b50c85-4cf7-4927-857c-e6d0fb5df6ab for instance d28c8f62-27b3-463a-8718-a5447816ed7c on hv-cinder-84580 Jun 15 10:23:56.910877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-e7c28494-c64f-480b-ae62-16519e1fef57 req-13c4775d-7c30-4358-8b45-e20f4b3d9267 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037484 Jun 15 10:23:56.911492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 161/321] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:23:57.456888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:57.456888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:57.461120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.461695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.462596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:57.463107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:57.687586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:57.696605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-517e0ef5-b49f-45f8-aca7-07d21a2e4aac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.247806 Jun 15 10:23:57.697721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 161/322] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:57 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:58.714695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:58.715729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:58.722284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:58.722719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:58.723479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:58.723908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:58.862314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:58.871501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-93559133-40e1-4868-954b-a272f5d6b591 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.161439 Jun 15 10:23:58.872082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 162/323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:58 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:59.151549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:23:59.152466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:59.158578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.159029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.159783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.160210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.184584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'flavor' on Instance uuid 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:23:59.524938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-91015b51-06a1-4dbc-8cfe-c3179bd67ed8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/action" status: 200 len: 32 microversion: 2.1 time: 0.378420 Jun 15 10:23:59.525564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 162/324] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:23:59 2022] POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:23:59.534900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:59.535503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:59.537615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:59.538265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:59.547857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.547857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.547857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.547857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.682100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:23:59.689577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99a8b4d7-44be-4ef1-902c-f5de51807bf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.158637 Jun 15 10:23:59.690137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 163/325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:59 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:23:59.890424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:23:59.890928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:23:59.892842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:59.898649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.899083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.899842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:23:59.900260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:23:59.919350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:00.032952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:00.040616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abca0d23-c859-4d83-966e-7ff1e1d06370 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.154521 Jun 15 10:24:00.041210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 163/326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:23:59 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:00.707559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:00.708536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:00.716516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:00.716977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:00.717772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:00.718212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:00.854646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:00.862424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8beefc08-6c3c-4215-bb16-3ef88ad3e5e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.158791 Jun 15 10:24:00.862983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 164/327] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:00 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:01.057445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:01.058010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:01.065243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:01.065729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:01.066493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:01.066928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:01.204487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:01.212858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-54cf1574-04e5-4a37-9482-85ddfcebeaac tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.159322 Jun 15 10:24:01.213552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 164/328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:01 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:01.889487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:01.889487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:01.889487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:01.889487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:01.890288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:01.890288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:02.024605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:02.032103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-716f5b41-491d-4d0c-b1d0-007fc1b85453 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.155896 Jun 15 10:24:02.032668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 165/329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:01 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:02.229361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:02.229993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:02.236436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:02.236880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:02.237660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:02.238087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:02.367675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:02.375415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f4e1242-1ffe-4624-8de5-c0cfd0b46fda tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.149912 Jun 15 10:24:02.376501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:02 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:03.048882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:03.049527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:03.055809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.056247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.057029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.057459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.184496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:03.191879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e679dca1-be84-46e2-bbb4-b87f40ad67d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.146829 Jun 15 10:24:03.192435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 166/331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:03 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:03.392208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:03.392845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:03.400284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.402149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.402149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:03.402149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:03.536239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:03.544501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd4ff8aa-b409-4ae7-af6d-c4c89ddac4c1 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.156164 Jun 15 10:24:03.545087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 166/332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:03 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:04.210072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:04.210677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:04.217048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.217486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.218233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.218667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.352992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:04.360459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de3b23d4-46c8-4290-98d3-ded1f8457cbd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.154822 Jun 15 10:24:04.361032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 167/333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:04 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:04.562251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:04.562899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:04.570216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.570661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.571414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:04.571847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:04.702072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:04.709489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4eb00a65-7a1f-41a8-803a-86c9fe1eb330 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.151142 Jun 15 10:24:04.710043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 167/334] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:04 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:05.378179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:05.378707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:05.385307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.385753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.386603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.387063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.391049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:05.518587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:05.526300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-557ce288-bf5a-4cbf-b933-c47f816fb9a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.152146 Jun 15 10:24:05.526864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 168/335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:05 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:05.728730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:05.729357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:05.736115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.736552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.737340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:05.737769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:05.869040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:05.876846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1837abb7-7172-425e-9b1b-ab7fb218be82 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.152747 Jun 15 10:24:05.877448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 168/336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:05 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:06.543363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:06.543967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:06.550142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.550582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:06.554904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.554904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:06.689410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:06.698587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6c00993-35e2-4bfe-9259-20b695dcf1e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.159227 Jun 15 10:24:06.699161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 169/337] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:06 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:06.894443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:06.895044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:06.902204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.902627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:06.903640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:06.903820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:07.040697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:07.048119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1764d60d-eff7-4982-9503-3d1368419ca4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.157441 Jun 15 10:24:07.048683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 169/338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:06 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:07.716178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:07.716783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:07.722991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:07.723433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:07.724189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:07.724620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:07.853980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:07.861450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41a36b5f-4803-45bb-8a53-592938f162f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.149094 Jun 15 10:24:07.862007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 170/339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:07 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:08.065951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:08.066459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:08.074757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:08.075304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:08.076151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:08.076666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:08.205734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:08.213051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-224d1f37-e545-4e8a-ae69-afbd91dffabe tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.151117 Jun 15 10:24:08.213618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:08 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:08.879323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:08.879919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:08.881812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:08.887301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:08.887730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:08.888489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:08.888915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:09.022857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:09.030645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-329b436b-9afb-4030-aaee-1ee34b90e9af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.155231 Jun 15 10:24:09.031298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:08 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:09.231235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:09.231834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:09.234253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=52 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:09.239169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:09.239606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:09.240360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:09.240786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:09.382734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:09.390875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22ede58d-a2f0-414b-81af-7b31498d955b tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.164860 Jun 15 10:24:09.391426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 171/342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:09 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:10.047631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:10.049257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:10.065682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.066130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:10.067744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.069151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:10.224853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:10.232765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f9207cd3-4ac4-438c-bc04-93305b234922 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.189003 Jun 15 10:24:10.233427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 172/343] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:10 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:10.408934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:10.413597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:10.417228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.417677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:10.418624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:10.419205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:10.557371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:10.565043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4830db3b-1c0b-40d7-ad88-543a7b044f03 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.160019 Jun 15 10:24:10.566581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 172/344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:10 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:11.249635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:11.250302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:11.256421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:11.256868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:11.257649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:11.258079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:11.392785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:11.408219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-06893627-6f3b-42c0-b696-9e7e463c6fd3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.162372 Jun 15 10:24:11.408789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 173/345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:11 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:11.582710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:11.583317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:11.590188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:11.590557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:11.591322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:11.591752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:11.721292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:11.728722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-31ba9539-bf65-4f2e-83db-a3c4d6fa9cb6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.149952 Jun 15 10:24:11.729310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 173/346] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:11 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:12.398125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-0558c262-4ca8-4c45-82ee-41951e32a573 req-625b45eb-bce6-404c-9c25-0650b5f3658a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28c8f62-27b3-463a-8718-a5447816ed7c", "name": "network-vif-plugged", "status": "completed", "tag": "b1b50c85-4cf7-4927-857c-e6d0fb5df6ab"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:12.407671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0558c262-4ca8-4c45-82ee-41951e32a573 req-625b45eb-bce6-404c-9c25-0650b5f3658a service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.407776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0558c262-4ca8-4c45-82ee-41951e32a573 req-625b45eb-bce6-404c-9c25-0650b5f3658a service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.421911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-0558c262-4ca8-4c45-82ee-41951e32a573 req-625b45eb-bce6-404c-9c25-0650b5f3658a service nova] Creating event network-vif-plugged:b1b50c85-4cf7-4927-857c-e6d0fb5df6ab for instance d28c8f62-27b3-463a-8718-a5447816ed7c on hv-cinder-84580 Jun 15 10:24:12.425452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:12.426148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:12.427152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-0558c262-4ca8-4c45-82ee-41951e32a573 req-625b45eb-bce6-404c-9c25-0650b5f3658a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 Jun 15 10:24:12.428005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 174/347] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:12.433387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.433757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.434565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.435003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.575348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:12.584056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f66dc0dd-513f-44a7-8592-060311fa1fec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.162874 Jun 15 10:24:12.584696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 174/348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:12 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:12.745942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:12.746641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:12.752929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.753413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.754204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:12.754639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:12.892518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:12.900274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fa51644-3155-4c19-81ca-ad8945c6eb35 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.158419 Jun 15 10:24:12.900852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 175/349] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:12 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:13.601413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:13.602028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:13.609575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.616213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:13.616213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.616213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:13.750719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:13.758290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5669dbbb-e2f1-4672-822a-e1db427c5341 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.160616 Jun 15 10:24:13.758848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 175/350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:13 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:13.919530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:13.920668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:13.926964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.937680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:13.937680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:13.937680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.062942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:14.070746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fe7b1ee0-9eef-41ee-9a69-c15c53c12288 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.156402 Jun 15 10:24:14.071460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 176/351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:13 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:14.775983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:14.776881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:14.783336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.783786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.784628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:14.785087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:14.920604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:14.928318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-42599e69-2a6b-4648-be9d-b037134e9f4c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.156526 Jun 15 10:24:14.928880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 176/352] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:14 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:15.087540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:15.088142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:15.094805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.095252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:15.096029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.096572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:15.238333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:15.246058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6da3118d-68ef-49af-9bed-dcdc05de10b5 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.162312 Jun 15 10:24:15.246826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 177/353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:15 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:15.945873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:15.946487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:15.955198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.955854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:15.956739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:15.957203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.095098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:16.103260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b57a6c41-6c46-4942-9547-dee9febc44f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.161508 Jun 15 10:24:16.103815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 177/354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:15 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:16.263915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:16.264633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:16.270845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.271290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.272059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:16.272504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:16.419916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:16.427749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84df09b4-5d2c-4207-9fa6-ecfec1e3c0ab tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1310 microversion: 2.1 time: 0.168533 Jun 15 10:24:16.428506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 178/355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:16 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1310 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:17.120834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:17.121486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:17.128167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.128617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.129424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.129861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.330072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:17.337807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8fbe2430-d362-45c2-9430-103547673dcb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.220760 Jun 15 10:24:17.340228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 178/356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:17 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:17.449596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:17.451355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:17.462200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.463418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.468197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:17.468197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:17.616262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:17.625333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0274d9d0-5599-4dde-8f25-c7dca09ce51e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1494 microversion: 2.1 time: 0.183138 Jun 15 10:24:17.625866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 179/357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:17 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1494 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:18.355676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:18.357060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:18.363857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.364307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.365131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:18.365569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:18.530202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:18.546985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4d9f325-d0fa-4cbe-80a1-7290563d5149 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.194391 Jun 15 10:24:18.562493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 179/358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:18 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:19.564678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:19.566300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:19.587792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.592630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.592630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:19.592630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:19.738949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:19.747294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13355900-d1eb-48df-aefb-16c3f0824cd7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.186016 Jun 15 10:24:19.748129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 180/359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:19 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:20.582475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.583044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:20.589780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.590648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.591603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.592209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.596591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:20.618450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:24:20.764709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.765276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:20.773072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.773529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.774849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.775291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.972877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9e29b81-baba-4232-875e-aa4cbb2cb2a6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 204 len: 0 microversion: 2.1 time: 0.393878 Jun 15 10:24:20.973758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 180/360] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:24:20 2022] DELETE /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:24:20.985513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.986601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:20.994748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.995696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:20.996775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:20.998099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:21.004635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:21.020235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47f7042e-c237-4a01-9602-94ee421ab689 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.257780 Jun 15 10:24:21.030220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 181/361] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:20 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:21.448822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:21.456341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ae6fde3-e1d4-432a-89ab-9fca624b2499 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1500 microversion: 2.1 time: 0.476441 Jun 15 10:24:21.457071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 181/362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:20 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1500 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:22.041335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:22.042577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:22.052497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.053186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.054457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.055352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.207543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:22.216030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c3b0ad2-e563-4861-a39a-48e9677d69a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.180223 Jun 15 10:24:22.216657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 182/363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:22 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:22.476127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:22.476866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:22.490802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.494627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.495758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:22.498882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:22.665065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:22.673916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-afeff255-9ccf-44c6-a436-c0d0cccf92f6 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1500 microversion: 2.1 time: 0.202600 Jun 15 10:24:22.674510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 182/364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:22 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1500 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:23.235797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:23.237866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:23.245163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.245879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.247937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.248565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.469475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:23.477132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6178566d-1800-4727-bb0a-308f1d91bb42 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.247742 Jun 15 10:24:23.477700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:23 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:23.691441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:23.695369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:23.701322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.701777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.702702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:23.703299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:23.904791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:23.913017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0de0200f-78ee-451f-957f-14e9175b49b4 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1500 microversion: 2.1 time: 0.225639 Jun 15 10:24:23.913857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 183/366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:23 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1500 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:24.499212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:24.500506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:24.513599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.514057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.514927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.515366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.920399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:24.936181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:24.937567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:24.952110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44bf9677-1a71-4e5a-9686-34ff1bb28436 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.460885 Jun 15 10:24:24.952891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 184/367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:24 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:24.959964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.961502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:24.966288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:24.967279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:25.190462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:25.202311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0eff2ee4-8d32-47fe-bbc7-a67c4a490e3e tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1500 microversion: 2.1 time: 0.275207 Jun 15 10:24:25.208505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 184/368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:24 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1500 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:25.972814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:25.983126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:25.994286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:25.995208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:25.997397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:25.998449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:26.016070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-5cbc3cc9-35c5-4829-8fbd-9e747ff6510a req-4caef0b6-265a-44db-9f16-fe70eb9d8c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28c8f62-27b3-463a-8718-a5447816ed7c", "name": "network-vif-deleted", "tag": "b1b50c85-4cf7-4927-857c-e6d0fb5df6ab"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:26.038209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5cbc3cc9-35c5-4829-8fbd-9e747ff6510a req-4caef0b6-265a-44db-9f16-fe70eb9d8c0f service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:26.050302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-5cbc3cc9-35c5-4829-8fbd-9e747ff6510a req-4caef0b6-265a-44db-9f16-fe70eb9d8c0f service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:26.060818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-5cbc3cc9-35c5-4829-8fbd-9e747ff6510a req-4caef0b6-265a-44db-9f16-fe70eb9d8c0f service nova] Creating event network-vif-deleted:b1b50c85-4cf7-4927-857c-e6d0fb5df6ab for instance d28c8f62-27b3-463a-8718-a5447816ed7c on hv-cinder-84580 Jun 15 10:24:26.067955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-5cbc3cc9-35c5-4829-8fbd-9e747ff6510a req-4caef0b6-265a-44db-9f16-fe70eb9d8c0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057039 Jun 15 10:24:26.071420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 185/369] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:24:26.076006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:26.229288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:26.238555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:26.256526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:26.257581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:26.258655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:26.261324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:26.365946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:26.377571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-590084d8-de8d-4a33-a782-2040941b0ae3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.408816 Jun 15 10:24:26.385055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 185/370] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:25 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:26.397542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:26.413294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-01e1d86c-ec58-4d62-8826-f834b90fb1d0 tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1458 microversion: 2.1 time: 0.192919 Jun 15 10:24:26.413884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 186/371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:26 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1458 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:27.395186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:27.395832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:27.402574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.403439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.405027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.405470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.435946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:27.437240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:27.455699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.455699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.456133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.456720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.501076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.503422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.503422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lazy-loading 'fault' on Instance uuid d28c8f62-27b3-463a-8718-a5447816ed7c {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:24:27.581080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4be529ee5e4765ada8eaee33e21c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73242c46698496ba8b80ce681417938', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:27.593384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c30b3c75-a2ab-4f54-b5e6-978a1af4d5ca tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 200 len: 1300 microversion: 2.1 time: 0.162945 Jun 15 10:24:27.593979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 187/372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:27 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:27.698936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:27.710723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f6e4af4-43ca-4618-a396-9ff28c6e639a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1498 microversion: 2.1 time: 0.319305 Jun 15 10:24:27.712053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 186/373] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:27 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:27.732577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661a36a9-85eb-47e4-863d-fe0b7b36186f"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:27.735997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:27.742130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.742573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.743665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.744096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.769715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Cannot 'attach_volume' instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 while it is in vm_state rescued Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/os-volume_attachments HTTP/1.1 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 74 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:24:27.771451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volumeAttachment": {"volumeId": "661a36a9-85eb-47e4-863d-fe0b7b36186f"}} Jun 15 10:24:27.773001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Cannot 'attach_volume' instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 while it is in vm_state rescued Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79', 'body': {'volumeAttachment': {'volumeId': '661a36a9-85eb-47e4-863d-fe0b7b36186f'}}} Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:24:27.773868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 while it is in vm_state rescued Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:24:27.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:24:27.776979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:24:27.776979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:24:27.776979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 while it is in vm_state rescued Jun 15 10:24:27.776979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:24:27.778637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 409 to user: Cannot 'attach_volume' instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 while it is in vm_state rescued {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:24:27.779635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-915f0394-4900-463f-b231-a251271f262b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053459 Jun 15 10:24:27.780073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 188/374] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:24:27 2022] POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:24:27.789084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:27.789709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:27.795962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.796514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:27.797201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:27.797632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.076153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-380f117e-b35f-4c5c-bdd5-4d1a8ea3bcd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/action" status: 202 len: 0 microversion: 2.1 time: 0.289497 Jun 15 10:24:28.078607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 187/375] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:24:27 2022] POST /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:24:28.087982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:28.088888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:28.098030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.098786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.099714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.100288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.337302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:28.349830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fcf9b217-b304-464c-8292-1d5c3d6a65c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.267429 Jun 15 10:24:28.351455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 189/376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:28 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:28.626710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:28.628828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] [instance: d28c8f62-27b3-463a-8718-a5447816ed7c] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:28.642919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.643867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.645102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:28.646364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:28.688122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] HTTP exception thrown: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Request method failure captured: Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c HTTP/1.1 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbMFq-_iZJA_OsJ5pTt8cAutO85YzIJ_EglhkFk9ZedE-_QAu3io0jWVMEANNG3ZFoFEMRJ79AmkGmEyjKY1owvb29-urXvFa5ikI4Q-g1THqYOMT2337c2KV1U5gxcAxhbpp5r-hMLa0XCBcZY1Mpd8MSN2j05defoFmRslyHn9L9U Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: e73242c46698496ba8b80ce681417938 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesActionsTest-2113882905 Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:24:28.690014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e73242c46698496ba8b80ce681417938"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e73242c46698496ba8b80ce681417938"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e73242c46698496ba8b80ce681417938"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e73242c46698496ba8b80ce681417938", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesActionsTest-2113882905 Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: e73242c46698496ba8b80ce681417938 Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesActionsTest-2113882905 Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesActionsTest-2113882905-project Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 1d4be529ee5e4765ada8eaee33e21c64 Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesActionsTest-2113882905-project Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. Jun 15 10:24:28.691230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'd28c8f62-27b3-463a-8718-a5447816ed7c'} Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:24:28.691923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. Jun 15 10:24:28.693107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:24:28.694141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] Returning 404 to user: Instance d28c8f62-27b3-463a-8718-a5447816ed7c could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:24:28.694141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d74fcecf-b8e9-4420-ba56-b7cb206eaa0f tempest-VolumesActionsTest-2113882905 tempest-VolumesActionsTest-2113882905-project] 10.222.0.60 "GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c" status: 404 len: 111 microversion: 2.1 time: 0.070988 Jun 15 10:24:28.709601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 188/377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:28 2022] GET /compute/v2.1/servers/d28c8f62-27b3-463a-8718-a5447816ed7c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:24:29.370059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:29.370976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:29.385936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:29.388666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:29.389700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:29.391464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:29.660163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:29.676833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e8242ed-0747-468c-a3aa-c7e17fcb0884 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.311694 Jun 15 10:24:29.687400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 190/378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:29 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:30.661859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fed9472-570e-4529-9224-dd7916be3caf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Action: 'create', calling method: .version_select at 0x7fc27a1c9790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1109776199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPOa3nolhKYvVtNXSVOBGmZzVBtBxDr+WP1/f61RLgT9GTXgDKAVcJ8kr7GubFWsoKIKY3s0M8UMHcgGxydQDyXLxI1Mr7qm0yYWTWOnShF2/AeLkKjsQJsUIXOdXRsmw=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:30.688143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-6fed9472-570e-4529-9224-dd7916be3caf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Getting quotas for project 492be26275404bc3a439ae049bf4b9f4. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:30.694822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-6fed9472-570e-4529-9224-dd7916be3caf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Getting quotas for user abbf3822f4a6415b964112a383ad5509 and project 492be26275404bc3a439ae049bf4b9f4. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:30.696587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:30.697431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:30.709050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:30.709505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:30.710288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:30.710721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:30.828549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fed9472-570e-4529-9224-dd7916be3caf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.491085 Jun 15 10:24:30.828549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 189/379] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:24:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:30.920807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:30.929045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74f77ec6-a0e7-493e-9980-a85e4ca058db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.237134 Jun 15 10:24:30.934876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 191/380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:30 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:31.947230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:31.947837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:31.962151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.963165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:31.964034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:31.964569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:32.162682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:32.174168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-185c688d-034c-498d-8d06-bd2229233f7b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.231224 Jun 15 10:24:32.175700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 190/381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:31 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:33.193707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:33.194374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:33.205133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:33.205545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:33.206286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:33.207564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:33.424790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:33.437606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a4b62ed-12ec-42fb-b9bd-275fcbce0647 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.247535 Jun 15 10:24:33.438190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 192/382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:33 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:34.455917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:34.457203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:34.463423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:34.463869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:34.464640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:34.465102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:34.624834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:34.632877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dbf10e76-650c-4368-9c74-0a4d508297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.180800 Jun 15 10:24:34.633484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 191/383] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:34 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:35.650386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:35.650991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:35.658213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:35.658656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:35.659417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:35.659847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:35.790728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:35.799022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-776ea976-adb2-496e-9d17-adc10ecfd2c5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.152531 Jun 15 10:24:35.799588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 193/384] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:35 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:36.816439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:36.817162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:36.823456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:36.823993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:36.825162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:36.826056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:36.964111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:36.973818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6cf1317a-8e5b-4720-ae06-5e35246e15b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1506 microversion: 2.1 time: 0.161093 Jun 15 10:24:36.974416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 192/385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:36 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:37.992556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:37.993296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:38.001891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:38.002338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:38.003108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:38.003548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:38.145427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:38.153267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e368bba4-efc7-4866-9a47-b08fdb0ee14e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1512 microversion: 2.1 time: 0.165241 Jun 15 10:24:38.153915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 194/386] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:37 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:41.102022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-faaa2eb3-57c7-4e2c-ad0d-2db596ae4b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: .version_select at 0x7fc27a02be50>, body: {"keypair": {"name": "tempest-keypair-1687625558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/itDj7gvaj0Kjv4rHQX4BR0Ns2HBC50w2rYVjrNymV1fftCwM1Uo4lLqXAqIT8Fzzo8EsrGKLCDs7jc5KZ3veezhNiwJppY3Ab3o3wbTPSd6QXnFbgirHfa9xp0dKHMw=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:41.106089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:41.107610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:41.118463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-faaa2eb3-57c7-4e2c-ad0d-2db596ae4b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for project ab32692641974828b6fa534495acca01. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:41.125524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-faaa2eb3-57c7-4e2c-ad0d-2db596ae4b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for user 5090fa81be4d41bbb62da2c4f273d537 and project ab32692641974828b6fa534495acca01. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:41.197574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-faaa2eb3-57c7-4e2c-ad0d-2db596ae4b2d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099323 Jun 15 10:24:41.198295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 193/387] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:24:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:43.630393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-354629876", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2941449-3bcb-4e99-87c3-70ca63e0e63f"}], "security_groups": [{"name": "tempest-securitygroup--2053336912"}], "key_name": "tempest-keypair-1687625558", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:43.642936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:48.150226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.213959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.215426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.220412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1393619071", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "networks": [{"uuid": "266bebcb-4e19-4f89-86c2-cbc1186aab2d"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:54.327941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] validate_networks() for [('266bebcb-4e19-4f89-86c2-cbc1186aab2d', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:24:54.360499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] validate_networks() for [('c2941449-3bcb-4e99-87c3-70ca63e0e63f', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:24:54.406441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.748504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:24:54.749483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:24:54.750025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:24:54.750438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:24:54.750875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:24:54.760755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:54.761832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:54.763183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:54.764848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:54.783082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Getting quotas for project 40cd185858444d8aaf78e72a740b624f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:54.787193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Getting quotas for user 80a318aa610e449fb6e480372ee61db8 and project 40cd185858444d8aaf78e72a740b624f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:54.802944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:24:54.805243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:24:54.826404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:24:54.827413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:24:54.830944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:24:54.830944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:24:54.830944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:24:54.840600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:54.842033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:54.843092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:54.843738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:54.863962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:24:54.869600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Getting quotas for user 5090fa81be4d41bbb62da2c4f273d537 and project ab32692641974828b6fa534495acca01. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:24:54.881376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:24:54.883540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:24:54.913564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b526527e-9cb9-41ec-90ac-264ac8a06879 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700020 Jun 15 10:24:54.915508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 194/388] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:24:54.926327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1facc87-860e-4407-8491-288ee60e5f5a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:54.926962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1facc87-860e-4407-8491-288ee60e5f5a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:54.979931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1facc87-860e-4407-8491-288ee60e5f5a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:54.988230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1facc87-860e-4407-8491-288ee60e5f5a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1219 microversion: 2.1 time: 0.065637 Jun 15 10:24:54.988804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 195/389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:54 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:54.998794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [6e54e2ec-d10e-4577-92c9-f52fbd39210d] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 10:24:56.007755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3d4444d-2ac6-4d4a-ab9f-dd98810ec0be tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:56.009132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3d4444d-2ac6-4d4a-ab9f-dd98810ec0be tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:56.011015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [6e54e2ec-d10e-4577-92c9-f52fbd39210d] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 56580. Jun 15 10:24:56.024825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9899a239-601a-4454-ba29-ee7883ba2f34 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 12.397991 Jun 15 10:24:56.028843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 195/390] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:24:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 12402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:24:56.049892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3b8bf4d9-8c6f-4b74-99ec-bf9349a7fadd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:56.057022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b8bf4d9-8c6f-4b74-99ec-bf9349a7fadd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:56.110914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3d4444d-2ac6-4d4a-ab9f-dd98810ec0be tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:56.123261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3d4444d-2ac6-4d4a-ab9f-dd98810ec0be tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1219 microversion: 2.1 time: 0.120862 Jun 15 10:24:56.125968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 196/391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:56 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:56.178109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3b8bf4d9-8c6f-4b74-99ec-bf9349a7fadd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:56.200325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3b8bf4d9-8c6f-4b74-99ec-bf9349a7fadd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1245 microversion: 2.1 time: 0.166283 Jun 15 10:24:56.204499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 196/392] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:57.143486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:57.146147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:57.153053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:57.154484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:57.155710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:57.156155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:57.223318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:57.223318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:57.225225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:57.230549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:57.231061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:57.232081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:57.233330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:57.250319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dad16191-1f7f-4c3a-b4c1-10d6bfa0ca84 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1215 microversion: 2.1 time: 0.112069 Jun 15 10:24:57.250894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 197/393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:57 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:57.303854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:57.314461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da879113-413e-4d01-933c-c936f51ed691 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1249 microversion: 2.1 time: 0.096945 Jun 15 10:24:57.324521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 197/394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1249 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:58.272066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:58.273664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:58.284025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:58.285071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:58.286481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:58.287240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:58.333776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:58.335147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:58.349362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:58.349916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:58.350795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:58.351298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:58.397697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:58.406680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e13cd63-956e-43a9-8fe1-7a7767bbb2de tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1271 microversion: 2.1 time: 0.141999 Jun 15 10:24:58.407263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 198/395] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:58 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:58.448873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:58.457486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a81ea17-b570-4135-a5f4-4aa8689468a2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1297 microversion: 2.1 time: 0.128823 Jun 15 10:24:58.458093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 198/396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:59.433186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:59.436043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:59.452174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:59.453322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:59.455216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:59.456278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:59.480105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:59.481368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:24:59.497163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:59.500878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:59.502563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:24:59.503700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:24:59.618360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:24:59.629152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0abe3d3d-ce62-45c8-89ce-4fd37ba2827c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1315 microversion: 2.1 time: 0.156839 Jun 15 10:24:59.630271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 199/397] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:00.106564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:00.115405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2fadd4b9-3fda-4ac1-9b30-271e0815b5c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.694631 Jun 15 10:25:00.117230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 199/398] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:24:59 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:00.648011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:00.648784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:00.658433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:00.659622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:00.660731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:00.661455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:00.758103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:00.771516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf56225b-cc76-44cd-805d-0ece3464b6ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1303 microversion: 2.1 time: 0.127074 Jun 15 10:25:00.783077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 200/399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:01.144733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.145380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:01.153451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:01.154839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:01.155849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:01.156296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:01.412981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:01.426047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c9c5fda-1c02-458b-84d1-7a3a89d9b7a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.285083 Jun 15 10:25:01.431370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 200/400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:01.602348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-c2b31d30-3a46-4fd1-a982-a9a389637ff2 req-b5c879d0-d360-4013-99de-6eb0291f3c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a594ad7-da50-4278-ab61-05ff53d411e0", "tag": "2e01adf6-8418-435d-b337-9c235e3048ba"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:01.615952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c2b31d30-3a46-4fd1-a982-a9a389637ff2 req-b5c879d0-d360-4013-99de-6eb0291f3c42 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:01.616609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c2b31d30-3a46-4fd1-a982-a9a389637ff2 req-b5c879d0-d360-4013-99de-6eb0291f3c42 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:01.630654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-c2b31d30-3a46-4fd1-a982-a9a389637ff2 req-b5c879d0-d360-4013-99de-6eb0291f3c42 service nova] Creating event network-changed:2e01adf6-8418-435d-b337-9c235e3048ba for instance 2a594ad7-da50-4278-ab61-05ff53d411e0 on hv-cinder-84580 Jun 15 10:25:01.636198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-c2b31d30-3a46-4fd1-a982-a9a389637ff2 req-b5c879d0-d360-4013-99de-6eb0291f3c42 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038851 Jun 15 10:25:01.637361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 201/401] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:01.791527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.792129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:01.804833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:01.805269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:01.806301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:01.806953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:02.179997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:02.215969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c724cf4-9cc2-497c-9b3d-0dc7c5fb520b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.418289 Jun 15 10:25:02.226593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 201/402] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:02.457829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:02.460284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:02.471642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:02.472667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:02.473664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:02.474252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:02.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:02.693940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5dfdcb6-5ca8-47f4-b95f-934a3dcbed53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.249845 Jun 15 10:25:02.707186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 202/403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:02 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:03.234330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.235580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:03.250463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:03.250920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:03.251812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:03.252153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:03.507351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:03.517801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f461e85-cac2-40f8-8dd2-6b084d4fa82f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.288618 Jun 15 10:25:03.518971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 202/404] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:03.654843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-37f719b6-c108-4b14-bb46-69ea9a4bb81f req-c54a1321-693e-4eb4-af8e-a7414919cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:03.664333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37f719b6-c108-4b14-bb46-69ea9a4bb81f req-c54a1321-693e-4eb4-af8e-a7414919cc53 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:03.665210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37f719b6-c108-4b14-bb46-69ea9a4bb81f req-c54a1321-693e-4eb4-af8e-a7414919cc53 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:03.678429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-37f719b6-c108-4b14-bb46-69ea9a4bb81f req-c54a1321-693e-4eb4-af8e-a7414919cc53 service nova] Creating event network-changed:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:25:03.686599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-37f719b6-c108-4b14-bb46-69ea9a4bb81f req-c54a1321-693e-4eb4-af8e-a7414919cc53 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 Jun 15 10:25:03.687908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 203/405] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:03.712804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.713433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:03.720663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:03.721508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:03.722649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:03.723295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:03.878149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:03.886315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4b261bb2-8ebf-40f9-876b-0c651e24361c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.178005 Jun 15 10:25:03.886999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 203/406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:04.536898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.537965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:04.547410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:04.548008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:04.549021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:04.549361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:04.704885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:04.713151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d739da68-6ce0-4128-abf7-97fe7a87c05d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.180955 Jun 15 10:25:04.713717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 204/407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:04.903375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.904773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:04.906915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:04.914936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:04.915698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:04.916545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:04.917063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:05.087896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:05.096437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8bdcf4a5-d10c-450d-9f48-ab1fee2b2c32 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.197482 Jun 15 10:25:05.105974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 204/408] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:05.730919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:05.732456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:05.738499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:05.740601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:05.741330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:05.742339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:05.742969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:05.911515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:05.920413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-353b5e2a-aef0-4d05-8474-10c8dfcee843 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.193411 Jun 15 10:25:05.920937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 205/409] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:06.115077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:06.116443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:06.125226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:06.127222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:06.127868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:06.128850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:06.129400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:06.296110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:06.304628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3ec7572-586b-43d7-a346-7fe526763d2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.194043 Jun 15 10:25:06.305762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 205/410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:06 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:06.938951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:06.939642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:06.941588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:06.947683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:06.948367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:06.949321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:06.949913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:07.118409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:07.127286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f8bfdf5-9cb9-4d7d-94ea-a68dfadc0385 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.193542 Jun 15 10:25:07.130989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 206/411] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:07.321779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:07.323409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:07.331016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:07.331468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:07.332244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:07.332677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:07.486085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:07.501046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7168107d-03aa-44e6-b596-f6236b4b6c3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.182818 Jun 15 10:25:07.502110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 206/412] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:07 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:08.149683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:08.150409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:08.162772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:08.163282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:08.168197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:08.168197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:08.317586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:08.328794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6c50417-21f9-48b7-ad36-5179a7836c67 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.185177 Jun 15 10:25:08.329453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 207/413] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:25:08.529955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:08.534077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:08.554790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:08.554790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:08.554790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:08.554790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:08.784877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:08.793373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c1d950d1-770d-4a7a-a3f8-89b6d6da3733 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.271904 Jun 15 10:25:08.793955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 207/414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:08 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:09.346187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:09.346855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:09.359101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.359930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:09.361101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.361881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:09.554568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:09.564952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ce20bad8-5f76-4e46-b5b4-223dd08e4fb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.223753 Jun 15 10:25:09.565571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 208/415] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:09.811221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:09.812587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:09.821470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.825088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:09.826729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:09.827525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:10.150756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:10.163386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd165b45-adfd-428e-949a-060f0f0cdc02 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.356412 Jun 15 10:25:10.165604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 208/416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:09 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:10.582626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:10.583816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:10.591228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:10.592467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:10.593556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:10.594176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:10.748374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:10.756511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5bd8f4d8-a95a-4121-a056-b1a0cc2196d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.177744 Jun 15 10:25:10.761035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 209/417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:11.187675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:11.189309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:11.201764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:11.202672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:11.203545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:11.204112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:11.340937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:11.348940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af2664c9-0dba-4139-a221-ac415bc82b3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.167629 Jun 15 10:25:11.349512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 209/418] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:11 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:25:11.774576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:11.776202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:11.784860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:11.785481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:11.787421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:11.788150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:11.952501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:11.960675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe38e9d2-29a3-4f42-a221-009b6e2f2ad3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.190181 Jun 15 10:25:11.961508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 210/419] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:12.366758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:12.367525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:12.373633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:12.374387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:12.374921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:12.375357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:12.517900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:12.525847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9747b620-06cd-41f5-92c6-2c9020b0113e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.162827 Jun 15 10:25:12.531259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 210/420] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:12 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:12.979248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:12.980096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:12.987391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:12.987911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:12.988762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:12.989231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:13.124989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:13.132869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cb0e1e5e-eff4-4f68-98aa-bff39b51d738 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.157956 Jun 15 10:25:13.133779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 211/421] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:12 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:13.178519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-35390c3f-f31e-4e05-ae39-b476dd0188d3 req-fb50be18-eef3-4e5c-a748-ec0ff6e26497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a594ad7-da50-4278-ab61-05ff53d411e0", "name": "network-vif-plugged", "status": "completed", "tag": "2e01adf6-8418-435d-b337-9c235e3048ba"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:13.186589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-35390c3f-f31e-4e05-ae39-b476dd0188d3 req-fb50be18-eef3-4e5c-a748-ec0ff6e26497 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:13.187223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-35390c3f-f31e-4e05-ae39-b476dd0188d3 req-fb50be18-eef3-4e5c-a748-ec0ff6e26497 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:13.198627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-35390c3f-f31e-4e05-ae39-b476dd0188d3 req-fb50be18-eef3-4e5c-a748-ec0ff6e26497 service nova] Creating event network-vif-plugged:2e01adf6-8418-435d-b337-9c235e3048ba for instance 2a594ad7-da50-4278-ab61-05ff53d411e0 on hv-cinder-84580 Jun 15 10:25:13.204221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-35390c3f-f31e-4e05-ae39-b476dd0188d3 req-fb50be18-eef3-4e5c-a748-ec0ff6e26497 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029943 Jun 15 10:25:13.204811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 211/422] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:25:13.542860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:13.543651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:13.549530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:13.549972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:13.550730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:13.551163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:13.679985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:13.689235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a27a7690-b961-4969-a0f0-ec3b1ce2c19c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.150116 Jun 15 10:25:13.691989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 212/423] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:13 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:14.150958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:14.151590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:14.158126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:14.158667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:14.159422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:14.159855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:14.297400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:14.304929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b2ee353-ec2d-4bc2-936d-00f0429de71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.158140 Jun 15 10:25:14.305521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 212/424] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:14.705930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:14.706534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:14.713143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:14.721831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:14.721831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:14.721831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:14.856679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:14.865655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4daf16c9-fcb4-446c-926a-9adceb30c37c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.163825 Jun 15 10:25:14.866186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 213/425] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:14 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:14.979745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-868842032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1109776199", "security_groups": [{"name": "tempest-secgroup-smoke-109580413"}], "networks": [{"uuid": "ad815562-7aea-4597-a4eb-d624c5dd26da"}], "block_device_mapping_v2": [{"uuid": "d895901e-0896-4b4e-a99b-3e7d45e3b24b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:15.203546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] validate_networks() for [('ad815562-7aea-4597-a4eb-d624c5dd26da', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:25:15.326515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:15.327180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:15.338455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.339021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:15.339825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.340800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:15.359641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:15.480298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:15.488505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77fd6d3a-5620-4976-bad6-53ebbfc5ddf0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.168823 Jun 15 10:25:15.498486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 214/426] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:15.729408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:25:15.729851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:25:15.730339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:25:15.730741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:25:15.731181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:25:15.740106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.740544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:15.741378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.741816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:15.760418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Getting quotas for project 492be26275404bc3a439ae049bf4b9f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:25:15.764381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Getting quotas for user abbf3822f4a6415b964112a383ad5509 and project 492be26275404bc3a439ae049bf4b9f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:25:15.822612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:25:15.825463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d895901e-0896-4b4e-a99b-3e7d45e3b24b',volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:25:15.883912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:15.885309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:15.892721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.893192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:15.893956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:15.894390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:16.026679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:16.034261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-febef4b2-1a98-4bdd-b55b-b8b97477b863 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.155422 Jun 15 10:25:16.034826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 215/427] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:15 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:16.346734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d280cc55-d447-49dd-92d5-50044bba287e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.370850 Jun 15 10:25:16.347412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 213/428] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:25:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:25:16.357408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa00b14d-4184-412a-b938-024c63e38e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:16.358018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa00b14d-4184-412a-b938-024c63e38e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:16.421184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fa00b14d-4184-412a-b938-024c63e38e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:16.429101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa00b14d-4184-412a-b938-024c63e38e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1088 microversion: 2.1 time: 0.075446 Jun 15 10:25:16.429677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 216/429] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:16.506764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:16.507403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:16.515829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:16.516265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:16.517254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:16.517908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:16.537824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:16.658664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:16.666627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11e2eae9-1aee-400a-b11a-92ea9d877d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.163760 Jun 15 10:25:16.667194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 214/430] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:17.052756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:17.053328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:17.061518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.063031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.064133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.064820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.250043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:17.259160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9aa5aae8-83e9-4390-9f69-c4ed0bf0146a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1319 microversion: 2.1 time: 0.210808 Jun 15 10:25:17.259742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 217/431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:17 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:17.447011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:17.448163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:17.455039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.455495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.456420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.456864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.521698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:17.529494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0fc4de79-9633-4274-b520-6672bf4b2f4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1138 microversion: 2.1 time: 0.086236 Jun 15 10:25:17.530053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 215/432] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:17.685669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:17.686270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:17.697415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.697415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.697415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:17.697415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:17.858040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:17.868360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70f2e011-06fc-4c1c-9357-7de6beca4920 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.186597 Jun 15 10:25:17.876470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 218/433] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:18.275337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:18.276627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:18.282541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.283019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.283747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.284184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.425790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:18.432949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c6e51d6-331f-43d9-be69-7c82a60089ad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1508 microversion: 2.1 time: 0.161371 Jun 15 10:25:18.433628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 216/434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:18 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:18.548378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:18.549202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:18.555410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.555858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.556626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.557156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.632860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:18.649427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-91e37804-3851-42f3-8526-69ac22c69d84 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1186 microversion: 2.1 time: 0.100457 Jun 15 10:25:18.649427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 219/435] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:18.897570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:18.898677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:18.908372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.909114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:18.909903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:18.910338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:19.025230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:25:19.025971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:25:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:25:19.149927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:19.170453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f252f80d-45c4-4f96-8811-3b7c292453d2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.276953 Jun 15 10:25:19.170453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 217/436] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:19.298422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-659df741-4075-4ec6-835f-9749e28e9f66 req-45bc5dc3-f468-4f66-b03e-0978ccf21187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "name": "network-vif-plugged", "status": "completed", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:19.313821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-659df741-4075-4ec6-835f-9749e28e9f66 req-45bc5dc3-f468-4f66-b03e-0978ccf21187 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:19.314262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-659df741-4075-4ec6-835f-9749e28e9f66 req-45bc5dc3-f468-4f66-b03e-0978ccf21187 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:19.339910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-659df741-4075-4ec6-835f-9749e28e9f66 req-45bc5dc3-f468-4f66-b03e-0978ccf21187 service nova] Creating event network-vif-plugged:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:25:19.350426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-659df741-4075-4ec6-835f-9749e28e9f66 req-45bc5dc3-f468-4f66-b03e-0978ccf21187 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056157 Jun 15 10:25:19.351445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 220/437] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:19.661380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:19.661986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:19.667921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:19.668359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:19.669151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:19.669585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:19.757740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:19.773947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-639aff20-a256-4dfd-a52e-274937efe337 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1204 microversion: 2.1 time: 0.115864 Jun 15 10:25:19.775005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 218/438] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1204 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:20.179275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:20.180055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:20.190953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:20.191422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:20.192184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:20.192704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:20.333982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:20.341868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0106238f-8cfe-4d36-ac97-b31cfc9723fe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.167333 Jun 15 10:25:20.343643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 221/439] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:20.794011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:20.794629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:20.801053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:20.801501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:20.802279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:20.802717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:20.933688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:20.942046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa8b4ddf-e420-4b97-89f7-1f354ddcfd71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.152293 Jun 15 10:25:20.942608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 219/440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:21.359104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:21.359709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:21.366324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:21.366766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:21.367526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:21.367957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:21.502199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:21.509763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7083e2a8-7880-4ca3-b839-0f277b75123e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.154491 Jun 15 10:25:21.510324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 222/441] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:21.959002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:21.959616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:21.965797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:21.966247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:21.967004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:21.967434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:22.136075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:22.144680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae5a0d59-a29a-4514-a094-6908325bad70 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.189328 Jun 15 10:25:22.145309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 220/442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:22.534903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:22.536736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:22.548357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:22.549136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:22.550322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:22.551352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:22.553759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-7cbb523a-b7d3-4157-82f6-90ceceedd172 req-aa263965-1b4a-4614-9d51-7087336cfe2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:22.563210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:22.565806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7cbb523a-b7d3-4157-82f6-90ceceedd172 req-aa263965-1b4a-4614-9d51-7087336cfe2b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:22.566498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7cbb523a-b7d3-4157-82f6-90ceceedd172 req-aa263965-1b4a-4614-9d51-7087336cfe2b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:22.595683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-7cbb523a-b7d3-4157-82f6-90ceceedd172 req-aa263965-1b4a-4614-9d51-7087336cfe2b service nova] Creating event network-changed:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:25:22.602065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-7cbb523a-b7d3-4157-82f6-90ceceedd172 req-aa263965-1b4a-4614-9d51-7087336cfe2b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052295 Jun 15 10:25:22.602852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 221/443] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:22.715769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:22.724427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2d8a719f-d21d-4ae7-83ba-04398f6e6eb4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.195585 Jun 15 10:25:22.725139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 223/444] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:23.162873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:23.163579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:23.171759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.173006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.173795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.174237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.447206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:23.457557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b3d32ef-5f8d-4d95-a028-bf19322ef81c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.298819 Jun 15 10:25:23.460759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 222/445] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:23.742342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:23.742981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:23.749869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.750344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.751276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:23.751701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:23.898298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:23.905887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ebb4753-09b2-4752-9d20-bb72563c7027 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.167311 Jun 15 10:25:23.906613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 224/446] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:24.474572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:24.475181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:24.481364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.481815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:24.482582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.483019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:24.682439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:24.690752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bbd92e45-1be8-4f74-91d5-e0bb733709ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.219993 Jun 15 10:25:24.691316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 223/447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:24.924463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:24.925424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:24.927820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:24.932905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.933381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:24.934432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:24.934917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:25.070049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:25.078074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ccf8fcf9-a08d-421a-afcc-c39463894236 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.158190 Jun 15 10:25:25.078662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 225/448] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:25:25.708771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:25.712671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:25.717717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:25.718265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:25.719248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:25.719765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:25.751466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:25.772904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:25.859182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:25.867853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c41f774-a406-4ca1-b1d9-f5a12a3bd487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.163189 Jun 15 10:25:25.872900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 224/449] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:26.095686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:26.096412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:26.103137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.103575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.104395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.104786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.250232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:26.258767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d06ffe4f-9aec-4dcf-b748-4f5fe59e198b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1371 microversion: 2.1 time: 0.167431 Jun 15 10:25:26.259422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 226/450] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:26.888323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:26.889459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:26.898259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.898706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:26.899830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:26.900402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.072760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:27.081597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66851744-051d-4f85-b75f-158b843a647f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1271 microversion: 2.1 time: 0.197580 Jun 15 10:25:27.082154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 225/451] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:27.276499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:27.277201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:27.279136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:27.285169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.285621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.286391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.286827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.434043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:27.444115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7be4c81b-6537-4f9a-9964-6f907da7f6ee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1562 microversion: 2.1 time: 0.171497 Jun 15 10:25:27.444685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 227/452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:27.462992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:27.463801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:27.473335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.474005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.474782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:27.475369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:27.584796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19ef8273-1d0d-4f9c-ad61-13a50875b7e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125080 Jun 15 10:25:27.586247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 226/453] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:25:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:28.099661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:28.100744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:28.108334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.108787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.109619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.110897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:28.342354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:28.351115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b2ef5a8-b877-48c0-9592-7dc3a2cb1e8e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.256042 Jun 15 10:25:28.351610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 228/454] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:28.981318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-4955dc31-bb40-44ea-afc8-8689e6a30c22 req-140da946-dc05-438f-8843-a91acbe60d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:28.990677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-4955dc31-bb40-44ea-afc8-8689e6a30c22 req-140da946-dc05-438f-8843-a91acbe60d4c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:28.992289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-4955dc31-bb40-44ea-afc8-8689e6a30c22 req-140da946-dc05-438f-8843-a91acbe60d4c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:29.003870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-4955dc31-bb40-44ea-afc8-8689e6a30c22 req-140da946-dc05-438f-8843-a91acbe60d4c service nova] Creating event network-changed:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:25:29.009239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-4955dc31-bb40-44ea-afc8-8689e6a30c22 req-140da946-dc05-438f-8843-a91acbe60d4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031613 Jun 15 10:25:29.009852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 227/455] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:29.370935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:29.372896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:29.383743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:29.384586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:29.385628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:29.386335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:29.587317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:29.601657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3b8e6749-c870-4476-9587-743389b25600 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.236278 Jun 15 10:25:29.613320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 229/456] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:30.620323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:30.620915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:30.627852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.628296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.629098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:30.629532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:30.811250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:30.819235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b4f5334-6515-4f56-81c1-1a128833dde9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.203245 Jun 15 10:25:30.819923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 228/457] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:31.839280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:31.840896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:31.856472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.857708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:31.859078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:31.859926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:32.116459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:32.128649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b1da9d0-e62f-4a0f-bf16-a017eb65a53f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.295333 Jun 15 10:25:32.129978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 230/458] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:33.146755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:33.147197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:33.160936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:33.161647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:33.162793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:33.163346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:33.334735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:33.356455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8bbed3cd-e542-453e-9f43-21f310d6c9ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.212027 Jun 15 10:25:33.359264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 229/459] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:34.377126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:34.377731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:34.391990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:34.392729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:34.393551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:34.393991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:34.551212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:34.561471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ade5032-73bf-4f0f-b9ac-0420b2fc8bea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.189390 Jun 15 10:25:34.562462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 231/460] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:35.582989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:35.588243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:35.594011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:35.597245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:35.598699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:35.599332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:35.893841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:35.903614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02674143-89b5-46fe-8376-9472e9ee3375 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.326157 Jun 15 10:25:35.916047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 230/461] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:36.925067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:36.925067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:36.930818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.931262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:36.932108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:36.932574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:37.071766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:37.075487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:37.081010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-605d1292-0938-4a2a-94fb-fbda7348ae30 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.162290 Jun 15 10:25:37.084219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 232/462] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:38.099750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:38.100540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:38.108323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:38.109104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:38.109991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:38.111332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:38.267737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:38.276731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c9891956-cfef-4616-afc8-b4beecad153d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.181886 Jun 15 10:25:38.277568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 231/463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:39.296023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:39.298738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:39.306854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:39.307581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:39.308643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:39.309345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:39.530969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:39.545057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa3f82f9-6fe5-45fe-9fa0-e990bd49c703 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.253650 Jun 15 10:25:39.547441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 233/464] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:40.571355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:40.573233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:40.581282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.581957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.582920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.583419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.696779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:40.698426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:40.714476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.718680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.721862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:40.721862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:40.759502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf5b4420-82b9-4d6b-b746-eb00b02a57bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/ips" status: 200 len: 146 microversion: 2.1 time: 0.066649 Jun 15 10:25:40.760889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 234/465] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:25:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/ips => generated 146 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:25:40.876158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:40.891581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:40.898085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-83ebe7c0-cd0e-40b0-9b9c-173928a53ff3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.338997 Jun 15 10:25:40.910309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 232/466] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:41.921478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:41.923306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:41.933724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:41.934301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:41.935346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:41.935996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:42.106319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:42.119725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-385fe2d4-fdb0-4aca-b779-bc2ec090b70d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.207622 Jun 15 10:25:42.128115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 235/467] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:42.237745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-92a6fdb0-b826-4002-a46e-81bc0091adc8 req-9d4bb4d5-1f47-458a-bb8c-06cb93f92c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "name": "network-vif-plugged", "status": "completed", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:42.247971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-92a6fdb0-b826-4002-a46e-81bc0091adc8 req-9d4bb4d5-1f47-458a-bb8c-06cb93f92c99 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:42.248416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-92a6fdb0-b826-4002-a46e-81bc0091adc8 req-9d4bb4d5-1f47-458a-bb8c-06cb93f92c99 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:42.265369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-92a6fdb0-b826-4002-a46e-81bc0091adc8 req-9d4bb4d5-1f47-458a-bb8c-06cb93f92c99 service nova] Creating event network-vif-plugged:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:25:42.272069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-92a6fdb0-b826-4002-a46e-81bc0091adc8 req-9d4bb4d5-1f47-458a-bb8c-06cb93f92c99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038027 Jun 15 10:25:42.273370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 233/468] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:43.138175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:43.139109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:43.146583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:43.147134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:43.148043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:43.148559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:43.248550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e1c90cc-ea52-40d6-903d-33fd90a79a31 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Action: 'create', calling method: .version_select at 0x7fc2797984c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1780355668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLcbC7cgWHC3HYPTOSzpriRXTiQxwN7TdT5fIGQiF3Fy4yW6lsWqKQsJpa3rOwjEf3/ogExKfb/AHKONj4rJNK7JF2FlSIG00d1Z4bXlII+wTnukcoT+zdGtekZv1F07A=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:43.263481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8e1c90cc-ea52-40d6-903d-33fd90a79a31 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:25:43.267430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8e1c90cc-ea52-40d6-903d-33fd90a79a31 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for user 0ac3d9b2893b4f078c2a379696aaff34 and project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:25:43.296740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:43.306616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4865241-42f4-46fc-86d0-50489347dcd8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.173262 Jun 15 10:25:43.307433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 234/469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:25:43.363668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e1c90cc-ea52-40d6-903d-33fd90a79a31 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.295687 Jun 15 10:25:43.367401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 236/470] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:25:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:44.325347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:44.326177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:44.334776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:44.335223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:44.335998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:44.336434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:44.489009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:44.497295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e39bd78b-049a-40f2-bab3-fdaa0c4c0993 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.177004 Jun 15 10:25:44.497865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 235/471] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:45.515919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:45.517475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:45.525367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:45.528445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:45.528445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:45.528932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:45.769337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:45.778605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e8ad62ee-714d-49e2-8c1b-13a44f0e4e3e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.267570 Jun 15 10:25:45.779509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 237/472] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:46.795923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:46.796662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:46.804810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.805271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.806172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:46.806508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:46.975895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:46.984118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9dc66e62-126b-4b42-a4d5-f86308c7b60b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.192142 Jun 15 10:25:46.984697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 236/473] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:48.002406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:48.003257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:48.010630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:48.011085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:48.011828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:48.012257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:48.153294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:48.161572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-66dac436-d92a-457c-8399-73e1b6bf3d7c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.163666 Jun 15 10:25:48.162136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 238/474] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:49.178896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:49.179515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:49.186410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:49.186859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:49.187632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:49.188086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:49.319090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:49.326957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fce9f2fb-577b-4392-a67c-5286095f0ff5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.152297 Jun 15 10:25:49.327520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 237/475] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:50.344582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:50.345346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:50.352110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:50.352562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:50.353362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:50.353802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:50.474975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:50.475540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:50.481837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:50.482284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:50.483061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:50.483496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:50.497700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:50.506473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37f77799-18fb-452f-bde5-f45e8955ae20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1259 microversion: 2.1 time: 0.165665 Jun 15 10:25:50.507047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 239/476] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:50.508522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8411cb2c-7fe1-48c1-b72b-d5c783228ce1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/ips" status: 200 len: 150 microversion: 2.1 time: 0.037534 Jun 15 10:25:50.509120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 238/477] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:25:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:51.525835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:51.526539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:51.534537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:51.534977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:51.535748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:51.536178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:51.678320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:51.686331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28cb8ea9-5d8d-4821-8c66-42058594b0f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1443 microversion: 2.1 time: 0.164585 Jun 15 10:25:51.686887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 240/478] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:51.704057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:51.705391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:51.711757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:51.712207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:51.712993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:51.713435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:51.849658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:51.857999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-870b6689-7ebb-4b11-9fb8-2b3936bc97e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1443 microversion: 2.1 time: 0.157682 Jun 15 10:25:51.859284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 239/479] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:25:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:53.992190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-6493e899-f3b4-4a79-99b1-5dc46c1292f1 req-6c28abc8-563a-44de-91cb-be113d86be82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:53.996140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:54.001659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-6493e899-f3b4-4a79-99b1-5dc46c1292f1 req-6c28abc8-563a-44de-91cb-be113d86be82 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:54.002738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-6493e899-f3b4-4a79-99b1-5dc46c1292f1 req-6c28abc8-563a-44de-91cb-be113d86be82 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:54.016352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-6493e899-f3b4-4a79-99b1-5dc46c1292f1 req-6c28abc8-563a-44de-91cb-be113d86be82 service nova] Creating event network-changed:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:25:54.022830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-6493e899-f3b4-4a79-99b1-5dc46c1292f1 req-6c28abc8-563a-44de-91cb-be113d86be82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034104 Jun 15 10:25:54.023625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 241/480] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:54.420647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbcceb54-4210-4244-baf4-37869c2b6056"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:54.421776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:54.428214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=38 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:54.430875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:54.431660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:54.432697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:54.433350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:54.827525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:54.831150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:54.841004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:54.841457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:54.842238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:54.842675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:54.868628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f74b8bcc-2617-4985-b55d-6afbc5a72144 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/ips" status: 200 len: 151 microversion: 2.20 time: 0.045689 Jun 15 10:25:54.873151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 242/481] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Jun 15 10:25:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:25:55.200763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8df38fec-5d08-418b-a020-0b91bc02d6ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784364 Jun 15 10:25:55.201500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 240/482] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:25:54 2022] POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:55.338972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0b662c-0601-4248-86f0-23c649f3a73b"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:55.339922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:55.342346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:55.348005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:55.348452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:55.349253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:55.349688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:56.342133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6528d916-eedc-480e-85cb-518023c3767c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.006934 Jun 15 10:25:56.349301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 243/483] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:25:55 2022] POST /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 194 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:57.081764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb31752b-036d-4085-88a8-d2b261ba157f", "device": "/dev/sdb"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:57.081764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:57.081764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:57.081764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:57.084117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:57.084117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:57.972008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dcab25f4-8a5a-45ae-93a1-43de22ce5fad tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "POST /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953354 Jun 15 10:25:57.972610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 241/484] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:25:57 2022] POST /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0/os-volume_attachments => generated 194 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:58.701503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:58.702143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:58.709186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:58.709633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:58.710412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:58.710852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:58.734964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lazy-loading 'flavor' on Instance uuid 68397bf4-b7e5-40fa-a541-3a52382f6fcc {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:25:59.278702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e494d631-b6ae-42a7-94f2-2290fa85585e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action" status: 202 len: 0 microversion: 2.20 time: 0.582801 Jun 15 10:25:59.279627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 244/485] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Jun 15 10:25:58 2022] POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:25:59.288996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:59.289706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:25:59.306047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:59.306725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:59.308224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:25:59.308825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:25:59.474210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:59.485670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:59.487670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:25:59.488891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d900ea56-be6c-46b0-ac4f-db56da786541 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.204186 Jun 15 10:25:59.489509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 242/486] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:25:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:00.514814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:00.515424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:00.522867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:00.523326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:00.524141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:00.524581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:00.678252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:00.686421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:00.687986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:00.689236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e83213a-2d60-4ccc-9841-f40f4d2a0b57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.179395 Jun 15 10:26:00.690317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 245/487] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:01.709937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:01.710540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:01.717134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:01.717574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:01.718326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:01.718751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:01.854255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:01.862922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:01.864533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:01.865745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5b3ec74-6a7e-4fa8-9b00-e46bbffacd62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.160492 Jun 15 10:26:01.866515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 243/488] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:02.885307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:02.885992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:02.893931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:02.894382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:02.895172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:02.895617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:03.042659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:03.052028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:03.053520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:03.054730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50fb864c-58fb-4fd6-97d4-73ee56c35c13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.173828 Jun 15 10:26:03.055278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 246/489] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:04.073717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:04.074323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:04.081325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:04.081771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:04.082537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:04.082973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:04.216404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:04.227342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:04.228797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:04.229981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c1fb264-b5c0-4620-9456-16c2442473ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.160159 Jun 15 10:26:04.230529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 244/490] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:04.933199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c594d461-37ef-4ac4-8782-b0cea4f6479d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:04.941575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c594d461-37ef-4ac4-8782-b0cea4f6479d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:04.941975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c594d461-37ef-4ac4-8782-b0cea4f6479d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:05.021324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c594d461-37ef-4ac4-8782-b0cea4f6479d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Going to try to stop instance {{(pid=118121) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 10:26:05.117324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:05.248575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:05.249241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:05.256684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:05.257275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:05.258056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:05.258493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:05.273887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c594d461-37ef-4ac4-8782-b0cea4f6479d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action" status: 202 len: 0 microversion: 2.1 time: 0.344850 Jun 15 10:26:05.274486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 247/491] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:26:04 2022] POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:26:05.283858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:05.285500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:05.292402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:05.292851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:05.293650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:05.294085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:05.407090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:05.417986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:05.419552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:05.420995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9aafc97-b339-4708-a817-5095e91a55cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.176671 Jun 15 10:26:05.429019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 245/492] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:05.436753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:05.446463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-95f7ed32-bf81-4224-8df5-28f56f275220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.167456 Jun 15 10:26:05.447032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 248/493] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:06.445641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:06.446618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.453897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.454342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.455182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.455595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.466139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:06.466746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:06.474839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.475668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.476656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:06.477566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:06.643553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:06.652055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:06.653618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:06.654825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c86c6e9-b869-4845-ac41-e3a4c6256341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.218689 Jun 15 10:26:06.655401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 246/494] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:06.667534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:06.676948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bb25dc96-4f2f-4639-9a0f-57d6a6f6a7ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.214631 Jun 15 10:26:06.677555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 249/495] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:07.678691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:07.679329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:07.686278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:07.686741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:07.687519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:07.687960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:07.695824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:07.696714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:07.703933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:07.704952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:07.706755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:07.707281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:07.872594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:07.877879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:07.883503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:07.885387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:07.886847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c348df4-86c5-43e4-8bf4-8f32275e7b90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.213809 Jun 15 10:26:07.887432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 247/496] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:07.903557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:07.912926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eaef0794-c286-4e01-aed2-e1c43dd62092 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.222936 Jun 15 10:26:07.919683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 250/497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:08.913503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:08.913503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:08.914872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.915315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:08.916081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.916510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:08.934733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:08.935304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:08.942929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.943369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:08.944126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:08.944556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:09.088046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:09.109913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:09.120280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3dcbea85-9f01-4062-9c16-a0008a449fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.189651 Jun 15 10:26:09.121727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:09.122138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 251/498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:09.123307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:09.124668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56edc545-e280-47a8-9027-a6e2ad9b8076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.222256 Jun 15 10:26:09.125290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 248/499] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:10.146611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:10.147782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:10.147952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:10.149083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:10.156451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.156904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.157485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.157733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.158142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.158303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.159331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:10.159885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:10.317341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:10.324188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:10.327062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25d0ec4d-6b1b-446c-8dee-3285f01e8da6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.187395 Jun 15 10:26:10.327656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 249/500] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:10.332936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:10.334435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:10.335585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3a738cc1-8264-4c6f-bf13-81e1873ac9fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.196040 Jun 15 10:26:10.336136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 252/501] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:11.345522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:11.347091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:11.355144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.355432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:11.356174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.356334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:11.356484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.356869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.363652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.364228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.365127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:11.365569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:11.523379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:11.527563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:11.532907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-67d7cbb3-32dc-4cd1-b643-9c5242fde8ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.191459 Jun 15 10:26:11.536623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:11.538249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:11.539489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9c9de643-455b-48c8-bcf4-1fd6783b1591 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.188275 Jun 15 10:26:11.540303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 253/502] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:11.548666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 250/503] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:12.550883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:12.551705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:12.559077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.559338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:12.559881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.560019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:12.560332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.560769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.567807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.568251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.569070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:12.569506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:12.704538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:12.714957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc9e6b21-0228-44a1-b0fe-8ef3c04ca4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.168118 Jun 15 10:26:12.716074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 254/504] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:12.721674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:12.747301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:12.747301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:12.747301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c83086d-3a2c-4043-a37c-ab16e120a5de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.180819 Jun 15 10:26:12.747765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 251/505] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:13.491977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6acb6b1c-1424-4776-8237-45dc7b3ca0d1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: .version_select at 0x7fc2796879d0>, body: {"keypair": {"name": "tempest-keypair-744582897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJcXG9ptvMk2dbGC9J+yXKcy0siexgkqxutR9QFnM9ywn3QJL06T05ZQdpkZjtOK4YSplaYfoSwIEs68ibkIemX/jsFhHUMkUtzCIlHthuLDRZPYn5VosxnpHXy1fZv9A=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:13.507012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-6acb6b1c-1424-4776-8237-45dc7b3ca0d1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:26:13.511919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-6acb6b1c-1424-4776-8237-45dc7b3ca0d1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:26:13.654775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6acb6b1c-1424-4776-8237-45dc7b3ca0d1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166565 Jun 15 10:26:13.655456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 255/506] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:26:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:13.733108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:13.733726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:13.740805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.741275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.742210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.742647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.764910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:13.765805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:13.773132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.773847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.774842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:13.775551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:13.902910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:13.912340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6ae234a-9c30-42d7-a3c6-8082f4df20eb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.183205 Jun 15 10:26:13.913023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 252/507] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:13.952112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:13.962245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:13.968024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:13.968024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e32e0ab-d989-44eb-9548-49c7ea524932 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.204993 Jun 15 10:26:13.968024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 256/508] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:14.929885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:14.930694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:14.942168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:14.942168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:14.942168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:14.942168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.000821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:15.003011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:15.010987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.010987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.012637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:15.013129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:15.167792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:15.173818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:15.178290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:15.180019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:15.181220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16c1c005-97ba-4f93-a582-d555a73f0fa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.196021 Jun 15 10:26:15.181968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 257/509] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:15.183979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-043e7bf9-ffaf-42d0-bdf5-6953c771e0c0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.257869 Jun 15 10:26:15.184539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 253/510] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:16.120402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1490402798", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae25dc20-3f67-427a-9874-3a8b1d755278"}], "security_groups": [{"name": "tempest-securitygroup--1866071692"}], "key_name": "tempest-keypair-744582897", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:16.206954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:16.207574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:16.214138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.214588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.215359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.215793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.227571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] validate_networks() for [('ae25dc20-3f67-427a-9874-3a8b1d755278', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:26:16.361243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:16.369526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03a9f8a8-6c03-47f6-b5e5-8cca36da5cd7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.166922 Jun 15 10:26:16.370093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 254/511] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:16.375314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:16.375917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:16.382913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.383359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.384306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.384735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.533064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:16.543333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:16.545135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:16.546854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9fc2df30-6052-4024-bd1d-58633be35d52 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.175338 Jun 15 10:26:16.549629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 255/512] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:16.862391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:26:16.862737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:26:16.863211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:26:16.863617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:26:16.864027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:26:16.873810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.874413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.875212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:16.875843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:16.894634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:26:16.898967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:26:16.911212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:26:16.913528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:26:17.062562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b323ddae-5dcf-4ddd-9a27-35726c3e016d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.946332 Jun 15 10:26:17.063246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 258/513] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:26:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:26:17.076887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7c2b3f9-3ff3-4f57-9298-031f8e3c31b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:17.078721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7c2b3f9-3ff3-4f57-9298-031f8e3c31b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:17.158532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7c2b3f9-3ff3-4f57-9298-031f8e3c31b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:17.167259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7c2b3f9-3ff3-4f57-9298-031f8e3c31b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1241 microversion: 2.1 time: 0.095435 Jun 15 10:26:17.167813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 256/514] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:17 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:17.389643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:17.391116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:17.403569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:17.404242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:17.405412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:17.406105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:17.568450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:17.569153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:17.577642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:17.580035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:17.580035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:17.580035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:17.581440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:17.586678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9c2084aa-6a48-4c0f-b13b-8a6f82c4a07b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.202078 Jun 15 10:26:17.587292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 259/515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:17.723896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:17.732340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:17.734892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:17.735181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db95e91d-53e0-4138-919a-f63cb5b8c88f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1723 microversion: 2.20 time: 0.171450 Jun 15 10:26:17.735772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 257/516] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:18.184839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.186376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.200640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.200640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.200640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.200640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.272866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.281137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e67e1071-d08c-4867-bdba-4eb9b44ed54b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1245 microversion: 2.1 time: 0.100659 Jun 15 10:26:18.281422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 260/517] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:18 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:18.605487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.606264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.613196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.613739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.614539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.614949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.755350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:18.758650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.765237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:18.768775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-68b6102d-4fc8-41e4-9e22-02619dd6d68f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.166682 Jun 15 10:26:18.769387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 258/518] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:18.779977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.780703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.781720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:18.782147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:18.927165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.934651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.936237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:18.937433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b2f3d58-2141-4504-a3e4-3b68ce4411ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.187661 Jun 15 10:26:18.937991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 261/519] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:19.297141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:19.297741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:19.305164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.305613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.306375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.307941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.370587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:19.379463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85a24438-89ad-4b0f-8d56-d6e3ea280583 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1293 microversion: 2.1 time: 0.086074 Jun 15 10:26:19.380230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 259/520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:19 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:19.787292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:19.787980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:19.794874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.795315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.796366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.796869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.937707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:19.946208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7b85f06-2c40-4962-8d6b-3d086f251e63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.163308 Jun 15 10:26:19.946787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 262/521] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:19.958907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:19.959585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:19.967506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.968204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:19.969125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:19.969620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.113150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:20.121521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:20.123056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:20.124263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3071072f-9d1e-4d4d-a3ef-12d0ecc511fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.170477 Jun 15 10:26:20.124821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 260/522] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:20.397218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:20.397814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:20.403916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.405036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.405991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.406510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.478132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:20.487502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-416ff807-a23d-42a3-a12a-f8675681d6a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1299 microversion: 2.1 time: 0.094062 Jun 15 10:26:20.488249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 263/523] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:20 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:20.963148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:20.963759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:20.970450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.970951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:20.971807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:20.972241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.143557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:21.144946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:21.152067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.152805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.153965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.154773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.226161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.237132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee4304bb-8ba7-4d4b-96c3-3eb5b7c970cc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.277153 Jun 15 10:26:21.237729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 261/524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:21.314291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.321886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.323689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.324784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0197fc45-a14b-436e-a0ad-e8aa14ff6d57 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.185899 Jun 15 10:26:21.325802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 264/525] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:21.506648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:21.507536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:21.514286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.514854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.516021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:21.516605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:21.696139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:21.704800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04e99615-e6e7-40df-91b0-0ff51e4af663 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.204091 Jun 15 10:26:21.706008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 262/526] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:21 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:22.119127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-91fdf68f-b5bf-482a-a872-117c60f83a09 req-2ed99a44-62ac-461b-a147-80ed0745e8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "name": "network-vif-plugged", "status": "completed", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:22.128528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-91fdf68f-b5bf-482a-a872-117c60f83a09 req-2ed99a44-62ac-461b-a147-80ed0745e8fb service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.128997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-91fdf68f-b5bf-482a-a872-117c60f83a09 req-2ed99a44-62ac-461b-a147-80ed0745e8fb service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.140947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-91fdf68f-b5bf-482a-a872-117c60f83a09 req-2ed99a44-62ac-461b-a147-80ed0745e8fb service nova] Creating event network-vif-plugged:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:26:22.146113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-91fdf68f-b5bf-482a-a872-117c60f83a09 req-2ed99a44-62ac-461b-a147-80ed0745e8fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030733 Jun 15 10:26:22.147319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 265/527] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:22.256348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:22.256952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:22.264357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.264804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.265611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.266049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.316091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-1ad38b9a-9262-41a9-98c9-740f81ca705c req-be038571-1e17-4b62-9f16-dccb6d6fb918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2f5859-7f7e-4ff6-9489-cf042c8dfe93", "tag": "96825d2b-5e77-418b-8449-7af5d7875a6c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:22.325964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1ad38b9a-9262-41a9-98c9-740f81ca705c req-be038571-1e17-4b62-9f16-dccb6d6fb918 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.331094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1ad38b9a-9262-41a9-98c9-740f81ca705c req-be038571-1e17-4b62-9f16-dccb6d6fb918 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.338181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-1ad38b9a-9262-41a9-98c9-740f81ca705c req-be038571-1e17-4b62-9f16-dccb6d6fb918 service nova] Creating event network-changed:96825d2b-5e77-418b-8449-7af5d7875a6c for instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 on hv-cinder-84580 Jun 15 10:26:22.343542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-1ad38b9a-9262-41a9-98c9-740f81ca705c req-be038571-1e17-4b62-9f16-dccb6d6fb918 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031817 Jun 15 10:26:22.344280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 266/528] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:26:22.351048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:22.351822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:22.358751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.359487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.360211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.360666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.366207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:22.510909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:22.515640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85a6f2e9-62e5-4945-b369-16e87dd9a6c5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.264725 Jun 15 10:26:22.516364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 263/529] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:22.547585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:22.557590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:22.561470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:22.561470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7dfda89e-a444-4897-9e28-5425d284f948 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.214676 Jun 15 10:26:22.561470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 267/530] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:22.726693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:22.727611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:22.733707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.734148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.734908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:22.735335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:22.933534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:22.941534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2803c69-80ee-4dd3-84db-53a0ba2be7de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.218597 Jun 15 10:26:22.942208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 264/531] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:22 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:23.534160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:23.534876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:23.543317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.543776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.544564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.544987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.578554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:23.587453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:23.587453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.587453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.587453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.587947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.607230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:23.684158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:23.694646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c228a1fc-906f-4903-a467-f912f6b16025 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.164677 Jun 15 10:26:23.695387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 268/532] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:23.732342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:23.741159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:23.742767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:23.743908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18847e37-c350-4d5b-97b1-ceda7dd1b466 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.169622 Jun 15 10:26:23.744449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 265/533] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:23.959406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:23.960009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:23.966523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.966960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:23.967708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:23.968133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.102482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.109946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3f2f64e-4f29-4ea7-9793-e3a7f61b5ab0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.154812 Jun 15 10:26:24.110496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 269/534] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:23 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:24.712537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:24.713172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:24.715854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=54 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:24.721195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.727868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.727868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.727868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.763001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:24.763548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:24.771081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.771523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.772276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:24.772704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:24.856550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.864924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8619b06a-6424-4196-83d9-ca46f7368967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.156098 Jun 15 10:26:24.865897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 266/535] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:24.907126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.915411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.916868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:24.918146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52d05df9-f404-4336-a47f-123ce20850cc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.159199 Jun 15 10:26:24.918704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 270/536] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:25.128090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:25.128715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:25.135016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.135465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.136286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.136716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.269054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:25.276570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30a17507-f751-44a4-86c2-6beb113b71be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.153073 Jun 15 10:26:25.277158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 267/537] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:25 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:25.881782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:25.882388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:25.884682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:25.889619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.890069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.890831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.891264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.937751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:25.938348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:25.945195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.945635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:25.946397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:25.946823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:26.027442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:26.040623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48686507-08a3-44a3-b562-7b66a9ba0171 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.162444 Jun 15 10:26:26.041262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 271/538] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:26.081834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:26.089869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:26.091265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:26.092405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50b53b4d-ca3c-4439-9d2b-07f15c43cb9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.158675 Jun 15 10:26:26.092953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 268/539] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:26.293970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:26.294578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:26.301253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:26.301850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:26.302717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:26.303148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:26.442011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:26.449534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6e0268d-5146-487c-9560-df0554d3aae3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.159403 Jun 15 10:26:26.450095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 272/540] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:26 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:27.057980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:27.058596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:27.066159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.066610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.067398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.067832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.110716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:27.111324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:27.113855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:27.114973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=10 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:27.120031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.120474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.121269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.121702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.166520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:27.261658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:27.271122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:27.272608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:27.273830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ecde586b-f0fb-4566-9765-c74628cb3a68 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.166946 Jun 15 10:26:27.274611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 273/541] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:27.432486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:27.440799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e40c5dc-bd81-4167-9c30-8ee25c4dfc73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.386636 Jun 15 10:26:27.441408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 269/542] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:27.466826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:27.467354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:27.474172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.474614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.475372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:27.475800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:27.613173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:27.620618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-31093f3d-ef72-4dce-baf7-a09dc1f09558 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.157976 Jun 15 10:26:27.621208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 274/543] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:27 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:28.293154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:28.293715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:28.301251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.301698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.302471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.302907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.434386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:28.442852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:28.444321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:28.445516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b494e0a-d500-4573-b67f-016d548060ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.156499 Jun 15 10:26:28.446073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 270/544] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:28.458383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:28.459012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:28.465654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.466099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.466971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.467299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.598686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:28.607051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77b5532e-8a2a-4b57-a841-f6cb1217ab51 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.152812 Jun 15 10:26:28.607619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 275/545] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:28.638927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:28.639627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:28.646230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.646674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.647434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:28.647867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:28.789490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:28.797356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34ec0600-a44e-4878-aa9c-480eace44691 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.162090 Jun 15 10:26:28.797860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 271/546] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:28 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:29.463771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:29.464523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:29.471199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.471690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.472508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.472939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.612532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.620936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.622459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.623678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d3da493-64e8-4a48-8770-78c275fd04ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.163818 Jun 15 10:26:29.624181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 276/547] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:29.625067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:29.625685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:29.632850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.633466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.634231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.634660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.766942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.775569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-01af6e17-fe68-4215-af5e-61ab544377e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.154681 Jun 15 10:26:29.776239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 272/548] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:29.815444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:29.816132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:29.822489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.823030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.823791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:29.824255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:29.961472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:29.969313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-403b0f2f-6843-4c5e-8ad0-9323fca98fdd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.158425 Jun 15 10:26:29.969813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 277/549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:29 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:30.642612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:30.643878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:30.650475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.651002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.651758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.652190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.784215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:30.792609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:30.794065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:30.794512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:30.794696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:30.795379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d5ada93-7d7d-4d4f-9ae5-595d34e8a2cf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.156719 Jun 15 10:26:30.795931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 273/550] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:30.801468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.801914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.802683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.803115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.939119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:30.948298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-672e3377-fae0-47ab-95ea-8910dd326b32 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.157874 Jun 15 10:26:30.948893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 278/551] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:30.986960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:30.987750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:30.994110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.994545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:30.995309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:30.995740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.140429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:31.148227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d182ea44-d89e-486b-99f5-0f5580217545 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.165560 Jun 15 10:26:31.148799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 274/552] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:30 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:31.813980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:31.814527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:31.821635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.822748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.822853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.823280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.962948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:31.965720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:31.966326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:31.972073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:31.973724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:31.974169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.974609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:31.974880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48cc230e-5987-4925-8022-410440be3bcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.164911 Jun 15 10:26:31.975383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:31.975522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 279/553] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:31.975804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:32.107546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:32.115693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae11f03f-3020-4820-b600-d99ec1c433fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.153639 Jun 15 10:26:32.116250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 275/554] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:32.165514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:32.166107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:32.172531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:32.173004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:32.173811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:32.174448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:32.306800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:32.314367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8d80ac9e-6cb8-4c69-8a5c-2bf8d51a319a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.152778 Jun 15 10:26:32.315567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 280/555] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:32 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:32.992860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:32.993570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:33.000166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.000603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.001397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.001822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.113992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1277689574", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780355668", "security_groups": [{"name": "tempest-secgroup-smoke-1383212853"}], "block_device_mapping_v2": [{"uuid": "2e038b41-174a-43d0-a800-06dba1bfb5cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2e5d567-e18a-49e3-9189-cd1f166f6ba9"}]}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:33.161426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.170452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.172365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.173587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5f3feea9-a099-4ede-8781-7d4cc23f0d6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.184671 Jun 15 10:26:33.174687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 276/556] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:33.190953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:33.190953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:33.195059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.195844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.196859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.197427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.247540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] validate_networks() for [('b2e5d567-e18a-49e3-9189-cd1f166f6ba9', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:26:33.351163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.362893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4072177d-d343-4154-9199-d4629cadc6cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.184315 Jun 15 10:26:33.363804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 277/557] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:33.371764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:33.371764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:33.377345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.378490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.379479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.380106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.558661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:33.566804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8842641-e7a6-4cf3-a86b-5062fa41a8e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.201272 Jun 15 10:26:33.567381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 278/558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:33 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:33.692558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:26:33.693000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:26:33.693477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:26:33.693885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:26:33.694320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:26:33.703365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.703815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.704610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:33.705072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:33.722677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:26:33.726701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for user 0ac3d9b2893b4f078c2a379696aaff34 and project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:26:33.810126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:26:33.810126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e038b41-174a-43d0-a800-06dba1bfb5cf',volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:26:34.196171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:34.196769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:34.203554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.203989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.204747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.205917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.273934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b82854f4-e5c0-4588-ab6e-1e1458fe6954 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164694 Jun 15 10:26:34.275528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 281/559] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:26:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:26:34.286901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e7de6d2e-3c2e-4712-96b5-8ae6978d0fbb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:34.287758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e7de6d2e-3c2e-4712-96b5-8ae6978d0fbb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:34.352752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e7de6d2e-3c2e-4712-96b5-8ae6978d0fbb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.360775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e7de6d2e-3c2e-4712-96b5-8ae6978d0fbb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1095 microversion: 2.1 time: 0.078530 Jun 15 10:26:34.365074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 282/560] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:34.380944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.387789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:34.388781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:34.389732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.391498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.393465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-afde9b91-1b68-440e-84fb-87306cd776aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.200452 Jun 15 10:26:34.394029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 279/561] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:34.396704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.397375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.398265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.399072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.535351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.543943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f8dd1b2-d187-402a-89d8-d7bc5c30adce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.159915 Jun 15 10:26:34.544527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 283/562] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:34.584625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:34.585264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:34.591625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.594920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.594920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:34.594920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:34.734508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:34.742339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77f93eb9-9755-49da-bc6e-06a4e17a19d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.162170 Jun 15 10:26:34.749851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 280/563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:34 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:35.378561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.379098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.385778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.386214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.386968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.387473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.412457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.413130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.419990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.430815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.430815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.430815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.451236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.459401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f5d033b0-0a3e-45c7-8959-d561b83d468a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.085414 Jun 15 10:26:35.461002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 284/564] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:35.560155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.561514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.562135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.569074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.569315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.569518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.570290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.570713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.571008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.572216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-05c62b54-fd0b-4bf1-a6df-3a82db46a981 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.164486 Jun 15 10:26:35.572772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 281/565] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:35.592362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:35.710565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.718410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c60883c-2704-4589-babe-8aff29769f6d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.160751 Jun 15 10:26:35.718968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 285/566] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:35.759705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:35.760305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:35.766272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.766708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.767458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:35.768367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:35.772806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:35.903510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:35.912095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de6d4a3b-731d-409e-bab4-27cebc990e6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.156034 Jun 15 10:26:35.912591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 282/567] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:35 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:36.478090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.478691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.485286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.485723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.486538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.486964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.547582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.555922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-705fc023-4f72-4652-92e8-ca4e0f2441f7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.081592 Jun 15 10:26:36.556477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 286/568] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:36.590636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.591236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.598111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.598761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.599573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.600012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.735261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.736271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.737777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.743811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.744245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.744375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.745216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.745648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.745861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.747011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47195159-f5d0-4975-9f74-c6a76ee5bb16 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.160244 Jun 15 10:26:36.747575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 283/569] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:36.878077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:36.886564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d9795361-d22f-4c18-b52f-bd6c74cce871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.153987 Jun 15 10:26:36.887164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 287/570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:36.928985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:36.929617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:36.935800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.936181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:36.936942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:36.937406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.067096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.074429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8431cce7-0e3a-41cf-b09a-38cbbf715c76 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.149313 Jun 15 10:26:37.074989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 284/571] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:36 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:37.573218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:37.573983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:37.582786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.583300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.584284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.584718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.650857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.658262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f46ea7e-e7d8-4393-9494-adc452d02713 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.089100 Jun 15 10:26:37.658871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 288/572] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:37.765093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:37.765691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:37.773447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.773886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.774640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.775070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.904233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:37.904842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:37.911791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.912446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.914268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:37.914387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.914720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:37.922783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.924259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:37.925558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c55b1b3-313d-4259-8fa1-d0e347c0be4d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.164349 Jun 15 10:26:37.929761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 285/573] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:38.050558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:38.058646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51d7168c-2729-4c7f-9c2e-4cb1a897b050 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.158546 Jun 15 10:26:38.059204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 289/574] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:38.092307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:38.092919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:38.099281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.099754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.100540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.100992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.235950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:38.244304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2745008a-a684-4662-9316-7a975ed30894 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.155758 Jun 15 10:26:38.244868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 286/575] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:38 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:38.676006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:38.676614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:38.683215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.683656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.684419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.684855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.746575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:38.755252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b5012b0-d16b-4433-a3fb-9dba1e0814b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.083659 Jun 15 10:26:38.755825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 290/576] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:38 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:38.944529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:38.945195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:38.952212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.952633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:38.953436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:38.953863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.075626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:39.076625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:39.083035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.083492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.084218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.084341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.084723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.093788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.095531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.097936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b658465d-6316-492b-8e2c-404fa2f3f1fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.158487 Jun 15 10:26:39.109573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 287/577] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:39.231354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.240028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-40b16cff-b86e-4ba4-8251-60b3f2e275c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.168204 Jun 15 10:26:39.240615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 291/578] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:39.261232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:39.261845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:39.271814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.271814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.271814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.271814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.409007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.417704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38d7a382-6d59-4aa6-8306-a2a6cab88e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.160346 Jun 15 10:26:39.418550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 288/579] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:39 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:39.772761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:39.773466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:39.780184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.780662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.781508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:39.781971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:39.846523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:39.855528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c07af625-8a4b-4c6f-82eb-99a5cc260e07 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.087425 Jun 15 10:26:39.856093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 292/580] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:40.117388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.117904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.124408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.124852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.125649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.126083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.257511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.258233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.264429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.264661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.265785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.265894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.266285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.273586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.275128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.276293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30b99283-35d7-43e8-b8e5-a88062ab842d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.162861 Jun 15 10:26:40.276857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 289/581] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:40.398328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.406385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e76fc3e-8854-4cb7-a29a-283698761998 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1723 microversion: 2.1 time: 0.153928 Jun 15 10:26:40.406943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 293/582] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:40.435091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.437737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.442450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.442901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.443667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.444100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.582664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.590845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a839781a-ae06-4682-87cb-c1b3e38a30eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.159576 Jun 15 10:26:40.591415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 290/583] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:40.872915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:40.873571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:40.880973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.881413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.882173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:40.882615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:40.952013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:40.960455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1e873f8-6f5a-45df-86be-60c3283de6a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1145 microversion: 2.1 time: 0.091288 Jun 15 10:26:40.961055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 294/584] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:40 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:41.294848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.295449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.303488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.303924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.304689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.305150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.425978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.426728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.433581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.434153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.435731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.436308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.476109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.485233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.487081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.488446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0994527-5a1c-4343-9cec-d2ef55608342 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.197515 Jun 15 10:26:41.489037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 291/585] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:41.608145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.608802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.616390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.616840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.617654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.618090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.621537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.632770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1687522e-dfc2-46f3-81ac-792c88cafb46 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1700 microversion: 2.1 time: 0.212307 Jun 15 10:26:41.636400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 295/586] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1700 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:41.651607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abb8a8e3-95e5-4268-98c3-e76506395f65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:41.665949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abb8a8e3-95e5-4268-98c3-e76506395f65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.665949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abb8a8e3-95e5-4268-98c3-e76506395f65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.684286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abb8a8e3-95e5-4268-98c3-e76506395f65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Going to try to start instance {{(pid=118121) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 10:26:41.791082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:41.798752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0887feef-73fd-420f-9e08-3396af3b3e1c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.194539 Jun 15 10:26:41.799992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 292/587] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:41.845497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abb8a8e3-95e5-4268-98c3-e76506395f65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action" status: 202 len: 0 microversion: 2.1 time: 0.198952 Jun 15 10:26:41.846524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 296/588] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:26:41 2022] POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:26:41.858034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.859039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.869536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.870274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.871572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.872303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.979116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:41.980405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:41.987339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.987809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:41.988585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:41.989044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.011792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.020264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf20f796-52d6-480f-890f-c1faf60bda0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.168978 Jun 15 10:26:42.020853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 293/589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:42.052011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.059899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-108599cb-3467-4035-9558-15baddb43617 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1193 microversion: 2.1 time: 0.085427 Jun 15 10:26:42.060459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 297/590] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:41 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:42.508154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:42.508760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:42.516162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.516162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.516585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.517049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.652727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.660890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.662428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.663628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fce995b-c313-43ae-b817-e662ae05ea5f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.159348 Jun 15 10:26:42.664193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 294/591] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:42.816382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:42.816904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:42.823201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.823650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.824420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:42.824852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:42.958804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:42.966459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c23529e-8763-492c-be8d-0388bba3329b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.154633 Jun 15 10:26:42.967018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 298/592] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:42 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:43.038057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:43.038656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:43.044606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.045075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.045825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.046258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.077691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:43.078345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:43.085161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.085612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.086794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.086947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.150212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:43.158275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3718aea3-5540-465a-a0da-7aec97412467 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1193 microversion: 2.1 time: 0.084600 Jun 15 10:26:43.158851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 299/593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:43 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:43.184208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:43.192792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de188bae-b67b-4249-aabe-0d39d8f7e0b2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.158999 Jun 15 10:26:43.193400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 295/594] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:43.682864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:43.683530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:43.690578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.691048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.691824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.692281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.712756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:43.840131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:43.849226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:43.850710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:43.851952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28997cde-0e47-409b-b749-597e6157ee81 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.173706 Jun 15 10:26:43.852482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 300/595] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:43.982634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:43.983164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:43.990447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.990887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:43.991642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:43.992073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.124368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:44.132239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c41488e-683d-42b6-8b05-1799fc531f7e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.153536 Jun 15 10:26:44.132822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 296/596] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:43 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:44.175865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:44.176489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:44.182939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.183383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.184147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.184579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.188680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:44.209915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:44.210519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:44.216994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.217539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.218307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.218738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.254584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:44.263466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10549575-f9cb-4306-984e-02ffbf65853f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1193 microversion: 2.1 time: 0.091165 Jun 15 10:26:44.263466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 301/597] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:44 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:44.357249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:44.366197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78666110-ed52-4f96-95e5-9f6c434fccb4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.160195 Jun 15 10:26:44.366765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 297/598] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:44.869863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:44.870536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:44.872567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:44.878461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.878771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:44.881237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:44.881237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.011400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.020220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.021719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.022947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-097b9de0-da44-4daa-bce3-63f3d80e62d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.157583 Jun 15 10:26:45.023496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 302/599] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:45.150521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:45.151243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:45.157433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.157873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.158722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.159157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.283551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:45.284098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:45.290841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.291873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.292217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.292509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.294838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.298279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:45.303369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ace67796-58a3-4b70-9731-258bdd5f1256 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.157260 Jun 15 10:26:45.303955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 298/600] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:45 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:45.357157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.364856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-13947805-1c63-475b-844c-7fc625bb18bd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1193 microversion: 2.1 time: 0.085235 Jun 15 10:26:45.365452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 303/601] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:45 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:45.383126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:45.383749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:45.389813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.390256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.391022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:45.391458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:45.524046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:45.532489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13352fa0-058e-4b93-8c15-7a0a40bb77ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.153065 Jun 15 10:26:45.533096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 299/602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:46.042375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:46.042987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:46.050350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.050628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.051346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.051783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.194928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.204399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.219024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.219024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-80f8d2c2-ffc4-4152-8884-1f4fccf43cad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.170907 Jun 15 10:26:46.219024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 304/603] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:46.320462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:46.321122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:46.328502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.328938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.329738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.330541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.383002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:46.383713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:46.390649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.391095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.391891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.392327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.459479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.467862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4d6eca3f-8521-4b80-b654-e8ec9f1816d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1193 microversion: 2.1 time: 0.088756 Jun 15 10:26:46.468503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 305/604] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:46.483143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.491240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0eb1336b-1773-4cc3-9944-c34510972d17 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.174787 Jun 15 10:26:46.491820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 300/605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:46 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:46.549930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:46.550595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:46.557402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.557845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.558664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.559240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.715093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:46.724945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-02d797d8-1184-4c17-a74c-ab9555a34448 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.178827 Jun 15 10:26:46.725682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 306/606] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:46.917227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-7a783974-b604-440e-a967-f7debf00c64e req-1c2a7132-ef71-4245-9022-cebcbdd8cd96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2f5859-7f7e-4ff6-9489-cf042c8dfe93", "name": "network-vif-plugged", "status": "completed", "tag": "96825d2b-5e77-418b-8449-7af5d7875a6c"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:46.928292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7a783974-b604-440e-a967-f7debf00c64e req-1c2a7132-ef71-4245-9022-cebcbdd8cd96 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:46.928824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7a783974-b604-440e-a967-f7debf00c64e req-1c2a7132-ef71-4245-9022-cebcbdd8cd96 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:46.943522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-7a783974-b604-440e-a967-f7debf00c64e req-1c2a7132-ef71-4245-9022-cebcbdd8cd96 service nova] Creating event network-vif-plugged:96825d2b-5e77-418b-8449-7af5d7875a6c for instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 on hv-cinder-84580 Jun 15 10:26:46.948908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-7a783974-b604-440e-a967-f7debf00c64e req-1c2a7132-ef71-4245-9022-cebcbdd8cd96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040675 Jun 15 10:26:46.949526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 301/607] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:47.235446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:47.236044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:47.243091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.243527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.244314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.244763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.438174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.447218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.448733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.449916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b146c703-d0b8-4eb2-9176-540bb8a0b0b3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1744 microversion: 2.20 time: 0.218421 Jun 15 10:26:47.450476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 307/608] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:47.490306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:47.491015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:47.497918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.498356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.499119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.499547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.508054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:47.508755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:47.516104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.519586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.519586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.519586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.718611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.727807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37e3290b-5584-411c-b49d-cbe3e865b83e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.223471 Jun 15 10:26:47.728393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 308/609] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:47 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:47.743804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:47.744423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:47.750979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.751468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.752850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:47.754328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:47.793796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.811118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c713a3f-9e3a-429a-9fa0-2d14a456ac8e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1201 microversion: 2.1 time: 0.323653 Jun 15 10:26:47.812473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 302/610] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:47 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1201 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:47.919080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:47.928942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2df70b33-eec5-4b2e-b777-8b77550fe840 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.189012 Jun 15 10:26:47.929556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 309/611] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:48.469018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:48.470006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:48.477973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.478727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.479882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.480495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.664537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.673601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.675143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.676281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-810f41c3-a9e5-449e-a1a4-78e5dec42bf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.211354 Jun 15 10:26:48.676835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 303/612] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:48.745886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:48.746494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:48.753844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.759020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.759020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.759020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.830102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:48.833689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:48.838595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.839046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.839861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.840505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.903156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.907385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:48.913299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-20ca41ab-d81c-41d7-82ff-dddb2702ba8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.171291 Jun 15 10:26:48.913923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 310/613] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:48 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:48.915448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82fd8012-aba8-49cf-a1b6-7ae5ecdf75aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1211 microversion: 2.1 time: 0.089525 Jun 15 10:26:48.916023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 304/614] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:48 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:48.948528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:48.949183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:48.956117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.956551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:48.957547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:48.957971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.093538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:49.102207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37dfae84-9c67-4b88-9cf1-0ce91fb3981b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.158785 Jun 15 10:26:49.108684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 311/615] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:49.695055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:49.696287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:49.703777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.704230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.705045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.706079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.931457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:49.934975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:49.934975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:49.938995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:49.940129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.940726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.941487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.941925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.948391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:49.952475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:49.954408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f438fd6-1c06-4f32-ad36-2d8a28272a43 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.263607 Jun 15 10:26:49.966830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 305/616] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:49.972541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:49.973440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:49.980871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.983124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:49.983124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:49.983124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.101802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:50.111758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:50.114469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56ae947d-6f6f-4e99-9b67-d6b732a470f0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1211 microversion: 2.1 time: 0.146118 Jun 15 10:26:50.119255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 306/617] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:49 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:50.125717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d7235c3-17a3-4788-a5f4-d57df12200d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.198717 Jun 15 10:26:50.126890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 312/618] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:49 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:50.133160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:50.133942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:50.152310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.152310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.155463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.156006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.569311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:50.577954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-445f3160-e865-40b1-b4b5-b66bf1d88826 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.455123 Jun 15 10:26:50.578471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 307/619] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:50.974238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:50.974771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:50.983179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.983816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:50.984675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:50.985500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.132417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:51.133164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:51.149881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.150372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.153728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.165570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.165918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.181903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.184479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.186673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bbd8ab85-96ab-42b2-ac5e-645494bb910e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.217258 Jun 15 10:26:51.187821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 313/620] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:51.195874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:51.196952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:51.216626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.217294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.218265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.219010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.557213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.575533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d346b9e-87de-4d1f-bb7a-ebe97f601109 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1367 microversion: 2.1 time: 0.386250 Jun 15 10:26:51.578980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 314/621] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:51 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:51.601264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:51.609881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:51.621712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.622399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.623290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:51.623835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:51.825143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.834948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7644c60b-8a01-4e04-9537-37044c5a455d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1709 microversion: 2.1 time: 0.239653 Jun 15 10:26:51.836455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 315/622] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1709 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:51.926535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:51.939554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41c73e47-055f-44db-885a-4f0ffca17ee1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1279 microversion: 2.1 time: 0.811172 Jun 15 10:26:51.941276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 308/623] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:51 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1279 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:52.209297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:52.210638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:52.228594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.229543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:52.230882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.231510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:52.561889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:52.573506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:52.575302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:52.576787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b87d87b2-cebd-4bf0-bd22-5b7108263b6f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.372023 Jun 15 10:26:52.577374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 316/624] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:52.606644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:52.607198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:52.638861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.639706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:52.659157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.660506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:52.684841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:52.686719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:52.724709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.725940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:52.731797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:52.732338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.026715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:53.030504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 2a594ad7-da50-4278-ab61-05ff53d411e0 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:26:53.088929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:53.103244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bcc0de65-feff-4481-889a-5c3ee48e4a55 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1558 microversion: 2.1 time: 0.511609 Jun 15 10:26:53.113590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 309/625] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:52 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1558 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:53.123709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:53.124641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:53.157228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.157812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.161373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.162055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.392948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:53.404104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-41ee4d17-f010-41fd-ad0a-79539e15e1ee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0/os-volume_attachments/eb31752b-036d-4085-88a8-d2b261ba157f" status: 202 len: 0 microversion: 2.1 time: 0.769586 Jun 15 10:26:53.406908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 317/626] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:26:52 2022] DELETE /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0/os-volume_attachments/eb31752b-036d-4085-88a8-d2b261ba157f => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:26:53.423533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c767ec89-42ab-45ff-bb3e-e70681d23cd0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1713 microversion: 2.1 time: 0.317766 Jun 15 10:26:53.427686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 310/627] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1713 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:53.438747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:53.440493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:53.459938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:53.465927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:53.466088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.466514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.468138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.468763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.485276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.492303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.496726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.496726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.623912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c039c3d-4c34-4706-a663-d89aa9b130d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194916 Jun 15 10:26:53.624789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 311/628] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:26:53 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:53.652674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-e78637a0-14d2-4618-a07d-d6dc7122ea77 req-a0ffef7c-d93f-4d4d-bd43-2e4cb3692dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd0d535-7284-4990-a7aa-9cb616268d39", "tag": "9efed795-e65a-463e-9459-226eeae54890"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:53.668446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e78637a0-14d2-4618-a07d-d6dc7122ea77 req-a0ffef7c-d93f-4d4d-bd43-2e4cb3692dc6 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.668889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e78637a0-14d2-4618-a07d-d6dc7122ea77 req-a0ffef7c-d93f-4d4d-bd43-2e4cb3692dc6 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.697896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-e78637a0-14d2-4618-a07d-d6dc7122ea77 req-a0ffef7c-d93f-4d4d-bd43-2e4cb3692dc6 service nova] Creating event network-changed:9efed795-e65a-463e-9459-226eeae54890 for instance 1bd0d535-7284-4990-a7aa-9cb616268d39 on hv-cinder-84580 Jun 15 10:26:53.708695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-e78637a0-14d2-4618-a07d-d6dc7122ea77 req-a0ffef7c-d93f-4d4d-bd43-2e4cb3692dc6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082317 Jun 15 10:26:53.709589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 312/629] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:53.720134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:53.724263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:53.724991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:53.730699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7e9df9e6-c014-4ce8-bc5d-ae2876f7018f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.322205 Jun 15 10:26:53.732416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 318/630] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:53 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:53.739362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.740109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:53.741115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:53.741546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:54.123657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:54.134806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:54.136331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:54.137778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1613f28-6494-4514-874c-b9f1621f5c60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.423927 Jun 15 10:26:54.138532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 313/631] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:54.753084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:54.754057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:54.762063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:54.762393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:54.763171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:54.763610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:54.954417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:54.964528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-122b37ca-1a81-4adc-bc84-338ba81e0500 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.216638 Jun 15 10:26:54.965348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 319/632] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:54 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:55.157486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:55.159323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:55.161985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=96 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:55.167490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.168291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.169351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.170006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.399404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:55.411222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:55.414257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:55.415529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d7d70fa-8ab1-4e8e-9f0b-c840d9d25a5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.263369 Jun 15 10:26:55.416174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 314/633] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:55.736190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:55.736730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:55.747862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-654f1c0b-36ce-459d-ba46-3d968fc49bd2 req-565dd83f-b764-42a8-bc8a-3788ae2542c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2f5859-7f7e-4ff6-9489-cf042c8dfe93", "tag": "96825d2b-5e77-418b-8449-7af5d7875a6c"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:26:55.772144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.776798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.781332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.781988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.787934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-654f1c0b-36ce-459d-ba46-3d968fc49bd2 req-565dd83f-b764-42a8-bc8a-3788ae2542c2 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.793712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-654f1c0b-36ce-459d-ba46-3d968fc49bd2 req-565dd83f-b764-42a8-bc8a-3788ae2542c2 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.831611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-654f1c0b-36ce-459d-ba46-3d968fc49bd2 req-565dd83f-b764-42a8-bc8a-3788ae2542c2 service nova] Creating event network-changed:96825d2b-5e77-418b-8449-7af5d7875a6c for instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 on hv-cinder-84580 Jun 15 10:26:55.851658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-654f1c0b-36ce-459d-ba46-3d968fc49bd2 req-565dd83f-b764-42a8-bc8a-3788ae2542c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103560 Jun 15 10:26:55.854222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 315/634] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:26:55.870519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:26:55.983813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:55.985249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:55.994933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.996286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:55.997414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:55.998315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:56.205882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:56.217109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-46943e1d-f632-428d-b8a2-2810b051e4a0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.237959 Jun 15 10:26:56.226134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 316/635] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:55 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:56.248496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d9a98a00-f4d1-45c7-a8d2-de78b2332165 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 204 len: 0 microversion: 2.1 time: 0.516251 Jun 15 10:26:56.249933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 320/636] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:26:55 2022] DELETE /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:26:56.258808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:56.263317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:56.267131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:56.268036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:56.269310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:56.270067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:56.442310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:56.442435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:56.442843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:56.447622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:56.451178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8577e2da-d580-475b-ba4d-fb50959fc2b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1560 microversion: 2.1 time: 0.196479 Jun 15 10:26:56.454374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 317/637] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:56 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:56.474548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:56.475389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:56.476576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:56.477293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:56.734480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:56.745211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:56.747003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:56.748395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c679d77e-a802-4140-9cf1-2750f8d88873 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.311897 Jun 15 10:26:56.749071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 321/638] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:57.241623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:57.246145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:57.260872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.262477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:57.264008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.264911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:57.472334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:57.473809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:57.482987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.489036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:57.490241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.493326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:57.533047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:57.550148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7cedaa2e-cf18-4bd7-88da-0d7c4e2ee863 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.317868 Jun 15 10:26:57.551814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 318/639] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:57 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:57.718901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:57.731729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-066a9f92-ff10-462e-a48d-9b6e3fef004a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1514 microversion: 2.1 time: 0.263529 Jun 15 10:26:57.733063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 322/640] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:57 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:26:57.772603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:57.773780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:57.785811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.787306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:57.789203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:57.790204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:58.067591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:58.093552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:58.093552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:58.093552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9ead444-4ef3-44d4-b201-4b08dd2027b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.316342 Jun 15 10:26:58.093908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 319/641] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:26:58.578776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:58.580025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:58.589928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:58.590371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:58.591213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:58.591648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:58.742130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:58.752240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f7362bd-7158-4fee-9376-12c490a9eb77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.186504 Jun 15 10:26:58.753254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 323/642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:58 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:58.766084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:58.767165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:58.776528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:58.777339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:58.778203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:58.778983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:58.935850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:58.944173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-be036be7-bf46-40b6-af3f-a46954789b7b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1514 microversion: 2.1 time: 0.183054 Jun 15 10:26:58.944779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 320/643] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:58 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:26:59.101794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:59.102957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:59.115207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.116037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:59.117744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.121932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:59.448939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:59.471173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:59.475211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:26:59.477928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-232260ac-1efb-4c63-8cf6-1f4c98be4a27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.381434 Jun 15 10:26:59.492124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 324/644] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:26:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:26:59.770864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:59.772131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:59.780559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.781450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:59.782470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.783125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:59.963970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:26:59.964778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:26:59.973910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.974758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:26:59.975792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:26:59.976746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:00.210763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:00.225495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-085f5455-9bb2-4703-85c3-e3289284aef0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1514 microversion: 2.1 time: 0.263865 Jun 15 10:27:00.226060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 325/645] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:59 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:00.283021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:00.295582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47990a60-2bbb-4f8a-a99b-6baac6c91fce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.527848 Jun 15 10:27:00.296725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 321/646] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:26:59 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:00.474197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-2102cb8e-e53d-4c88-b5da-37c5f4d38afc req-30c08594-752c-4c20-905c-444f5404f819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a594ad7-da50-4278-ab61-05ff53d411e0", "name": "network-vif-deleted", "tag": "2e01adf6-8418-435d-b337-9c235e3048ba"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:00.485693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-2102cb8e-e53d-4c88-b5da-37c5f4d38afc req-30c08594-752c-4c20-905c-444f5404f819 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:00.486207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-2102cb8e-e53d-4c88-b5da-37c5f4d38afc req-30c08594-752c-4c20-905c-444f5404f819 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:00.501863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-2102cb8e-e53d-4c88-b5da-37c5f4d38afc req-30c08594-752c-4c20-905c-444f5404f819 service nova] Creating event network-vif-deleted:2e01adf6-8418-435d-b337-9c235e3048ba for instance 2a594ad7-da50-4278-ab61-05ff53d411e0 on hv-cinder-84580 Jun 15 10:27:00.509016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-2102cb8e-e53d-4c88-b5da-37c5f4d38afc req-30c08594-752c-4c20-905c-444f5404f819 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039658 Jun 15 10:27:00.511068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 326/647] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:27:00.517440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:00.521276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:00.535822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:00.535822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:00.536195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:00.536910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:00.791499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:00.813585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:00.819664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:00.826875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0de52b52-6002-49a2-b969-abbe57fdde7e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.320118 Jun 15 10:27:00.829264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 322/648] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:01.244698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:01.246465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:01.254241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.255800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.256605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.257232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.325369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:01.327125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:01.348335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.350735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.352502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'fault' on Instance uuid 2a594ad7-da50-4278-ab61-05ff53d411e0 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:27:01.355340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.358934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.361341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.367639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.462890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:01.485533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb21eb56-2d67-4c1c-a368-d765e9de5a37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1309 microversion: 2.1 time: 0.245132 Jun 15 10:27:01.504893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 327/649] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:01 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:01.671878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:01.684734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd5dbdcb-6795-4a5a-81b5-4ae0bb35889b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.369695 Jun 15 10:27:01.685782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 323/650] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:01 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:01.865654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:01.867135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:01.880510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.881951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:01.884418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:01.885521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.146645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:02.157134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:02.173181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:02.173181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27e39cd5-31f9-427a-9994-513de53b7381 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.304959 Jun 15 10:27:02.173181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 328/651] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:02.516311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:02.517156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:02.527147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:02.533461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.533461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:02.533461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.589739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:02.590674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.592737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'fault' on Instance uuid 2a594ad7-da50-4278-ab61-05ff53d411e0 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:27:02.648487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:02.660936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a40ad13c-061f-4c67-889c-80593a6cdbe9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 200 len: 1309 microversion: 2.1 time: 0.148636 Jun 15 10:27:02.663171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 324/652] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:02 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 1309 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:02.720340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:02.721624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:02.729581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:02.730026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.730798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:02.731228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:02.911073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:02.919444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f850064c-425f-4e0c-853c-9a9b0892f3b1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.211648 Jun 15 10:27:02.920372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 329/653] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:02 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:03.182977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:03.183593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:03.190806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:03.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.193151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:03.390578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:03.399748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:03.401353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:03.402623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa67f223-aee6-434f-b69e-f5347683f35c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.223589 Jun 15 10:27:03.403220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 325/654] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:03.691527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:03.692209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 2a594ad7-da50-4278-ab61-05ff53d411e0] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:03.701491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.702210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:03.702990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.703442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:03.719612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 HTTP/1.1 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:27:03.722048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. Jun 15 10:27:03.723933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '2a594ad7-da50-4278-ab61-05ff53d411e0'} Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:27:03.724940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. Jun 15 10:27:03.726678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:27:03.727779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 404 to user: Instance 2a594ad7-da50-4278-ab61-05ff53d411e0 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:27:03.727779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c35d48a2-f2fb-49d3-8ea9-bb8d12e09101 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0" status: 404 len: 111 microversion: 2.1 time: 0.036255 Jun 15 10:27:03.727779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 330/655] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:03 2022] GET /compute/v2.1/servers/2a594ad7-da50-4278-ab61-05ff53d411e0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:27:03.938506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:03.939519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:03.947811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.948366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:03.949268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:03.949772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:04.114517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:04.123048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d4bc5be-2b9b-49dd-b83b-10ce596e3738 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.190333 Jun 15 10:27:04.123990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 326/656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:03 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:04.421833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:04.422666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:04.431251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:04.431726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:04.432631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:04.433134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:04.475038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1458379860", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:04.534253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] validate_networks() for None {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:27:04.597048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:04.605893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:04.607290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:04.608614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddd62008-3eff-4d6a-8ff5-9eb28bb84cbe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.190730 Jun 15 10:27:04.609193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 331/657] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:04.858004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:27:04.858437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:27:04.859070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:27:04.859520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:27:04.859912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:27:04.870274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:04.870723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:04.871534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:04.872014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:04.892028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Getting quotas for project 57b2cd6b94be49228fec6c9f92d1ccc1. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:27:04.897878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Getting quotas for user c0449a8072f9479d827fb655bb0383e3 and project 57b2cd6b94be49228fec6c9f92d1ccc1. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:27:04.910863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:27:04.913345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:27:05.078633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-31dc2c27-5608-4c9b-92a5-4fadad01d780 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608270 Jun 15 10:27:05.079288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 327/658] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:27:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:27:05.090026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93928f36-c61c-4938-851e-a18e58cc7a4f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:05.090673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93928f36-c61c-4938-851e-a18e58cc7a4f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:05.141791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:05.142807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:05.150437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:05.150894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:05.151723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:05.152166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:05.156373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93928f36-c61c-4938-851e-a18e58cc7a4f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:05.164384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93928f36-c61c-4938-851e-a18e58cc7a4f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1215 microversion: 2.1 time: 0.078067 Jun 15 10:27:05.165206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 332/659] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:05 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:05.354468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:05.363596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-109975d1-a7af-4037-a9e8-b86c67da0227 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.226553 Jun 15 10:27:05.364180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 328/660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:05 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:05.816043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:05.816644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:05.823808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:05.824381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:05.825504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:05.829266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:05.988402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:05.998488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:06.000078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:06.001275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22f1c481-9a17-4b47-ba51-22c4ffc17478 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.376867 Jun 15 10:27:06.002037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 333/661] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:06.181344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e79f2254-b186-46be-9eff-31b3f81ccbc2 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:06.182139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e79f2254-b186-46be-9eff-31b3f81ccbc2 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:06.240291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e79f2254-b186-46be-9eff-31b3f81ccbc2 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:06.253632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e79f2254-b186-46be-9eff-31b3f81ccbc2 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1215 microversion: 2.1 time: 0.075217 Jun 15 10:27:06.254711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 329/662] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:06 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:06.387176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:06.388408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:06.399725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:06.400481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:06.401952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:06.406587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:06.411595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:06.598838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:06.607345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c412c9c-faf6-46d0-9e71-54fb4cd7389d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.227481 Jun 15 10:27:06.607915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 334/663] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:06 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:07.021382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:07.021993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:07.028570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.029041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.029818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.030249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.169342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:07.179032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:07.180527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:07.181768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86273016-542e-4e6f-9eec-24c2bd3c4a6c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.165281 Jun 15 10:27:07.182352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 330/664] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:07.279361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:07.280021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:07.288730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.289207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.289996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.290438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.357388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:07.366108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-909596d6-dfdb-45de-a4f2-a0bd9672055c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1219 microversion: 2.1 time: 0.090549 Jun 15 10:27:07.366692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 335/665] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:07 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:07.625033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:07.625700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:07.632718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.633209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.634058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:07.634502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:07.787875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:07.796709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d5ef0ad2-ed02-46d8-9e8d-8786305e3adb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.175440 Jun 15 10:27:07.797239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 331/666] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:07 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:08.210944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:08.211533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:08.218321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.218763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:08.219537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.219969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:08.376149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:08.386198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:08.386881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:08.388049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:08.389217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:08.390454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-82f68510-9c48-4134-8091-eb8fb1d3a9c9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.183446 Jun 15 10:27:08.391026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 336/667] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:08.401171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.402213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:08.403647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.404430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:08.495834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:08.504448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94fcb712-b245-42d7-a062-762771fbdc09 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1219 microversion: 2.1 time: 0.123909 Jun 15 10:27:08.505092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 332/668] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:08 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:08.819205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:08.820041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:08.829929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.831253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:08.832195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:08.832736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:09.006794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:09.016035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8104778a-4563-4b30-a2fb-db57100a536a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.203845 Jun 15 10:27:09.016634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 337/669] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:08 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:09.414401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:09.415142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:09.422833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:09.423335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:09.424155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:09.424748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:09.538075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:09.538685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:09.566102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:09.566847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:09.569302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:09.570097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:09.618368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:09.633021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:09.637467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:09.640330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f138f58f-63e9-4bad-aa91-13f106214650 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1739 microversion: 2.20 time: 0.229902 Jun 15 10:27:09.642111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 333/670] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:09.678382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:09.687061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2aed7b8c-d27f-4653-8017-b5cf1943e099 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1267 microversion: 2.1 time: 0.167591 Jun 15 10:27:09.687688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 338/671] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:09 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:10.034563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:10.035297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:10.042078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.042522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.043319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.043751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.217249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:10.231106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-596ae8e4-dd3b-4f0d-8561-2c68bc5078ac tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.200928 Jun 15 10:27:10.232149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 334/672] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:10 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:10.665031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:10.666261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:10.679102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.679845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.681249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.682008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.710087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:10.711450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:10.724292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.733155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.733155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:10.733155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:10.869440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:10.874990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:10.881491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f67bb548-286e-4325-87bc-c0ef060268dc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1267 microversion: 2.1 time: 0.178886 Jun 15 10:27:10.882677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 335/673] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:10 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:10.898065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:10.910034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:10.912222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:10.914274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e57c1fd-732a-4f85-ae02-56bab759f72e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.257087 Jun 15 10:27:10.915056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 339/674] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:11.254667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:11.256131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:11.272855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.273713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:11.275177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.275794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:11.905741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:11.906761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:11.916622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:11.921590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.922946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:11.925818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.926816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:11.938491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c93b7d4-e47d-45af-b58f-33cbf2a75511 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.690459 Jun 15 10:27:11.954076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 336/675] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:11 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:11.969057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:11.970361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:11.983290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.985169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:11.987913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:11.989174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:12.046175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:12.064544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-946ea10c-3911-4a16-aae4-626403eedc06 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1273 microversion: 2.1 time: 0.165466 Jun 15 10:27:12.065433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 340/676] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:11 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:12.232903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-054268a4-9f39-4d1a-bab2-8e3b90f2bf51 req-18ac119f-6cfa-4d25-b647-c1f9f52439dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd0d535-7284-4990-a7aa-9cb616268d39", "name": "network-vif-plugged", "status": "completed", "tag": "9efed795-e65a-463e-9459-226eeae54890"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:12.250535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-054268a4-9f39-4d1a-bab2-8e3b90f2bf51 req-18ac119f-6cfa-4d25-b647-c1f9f52439dc service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:12.251255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-054268a4-9f39-4d1a-bab2-8e3b90f2bf51 req-18ac119f-6cfa-4d25-b647-c1f9f52439dc service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:12.257740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:12.272990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-054268a4-9f39-4d1a-bab2-8e3b90f2bf51 req-18ac119f-6cfa-4d25-b647-c1f9f52439dc service nova] Creating event network-vif-plugged:9efed795-e65a-463e-9459-226eeae54890 for instance 1bd0d535-7284-4990-a7aa-9cb616268d39 on hv-cinder-84580 Jun 15 10:27:12.273255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:12.277192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:12.279654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-edaec6aa-d263-453a-b940-a299efcd15c5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.322487 Jun 15 10:27:12.281025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 337/677] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:12.282460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-054268a4-9f39-4d1a-bab2-8e3b90f2bf51 req-18ac119f-6cfa-4d25-b647-c1f9f52439dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059111 Jun 15 10:27:12.284111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 341/678] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:27:12.970608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:12.972467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:12.982006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:12.982637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:12.983680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:12.984286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:13.087419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:13.088495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:13.099214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:13.099930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:13.101289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:13.101953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:13.182523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:13.193071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e086e4a4-729a-46c7-9fec-032bfed5f40c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.228903 Jun 15 10:27:13.193683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 338/679] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:12 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:13.287799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:13.296545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f68a71f9-4d6a-4534-a2bb-502c664dab15 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.215391 Jun 15 10:27:13.297193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 342/680] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:13 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:13.304695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:13.305429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:13.313375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:13.313883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:13.315592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:13.315592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:13.499428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:13.509700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:13.511200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:13.512493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc00343c-6503-45e9-8bcb-16a9c073956f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.213115 Jun 15 10:27:13.512990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 339/681] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:14.218776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:14.219537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:14.227999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.230460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.230460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.230460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.318600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:14.319654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:14.333131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.333670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.334546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.335045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.417693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:14.428029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36059425-e7b9-471c-8bc4-adbead4812e5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.213421 Jun 15 10:27:14.428855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 343/682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:14 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:14.519607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:14.533001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:14.533483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:14.539483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c67d946-e16a-47e3-acc6-9d65d816a866 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.225586 Jun 15 10:27:14.539483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 340/683] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:14 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:14.544200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.545209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.547444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:14.547790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:14.719243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:14.735607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:14.738720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:14.740660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-12ac1d7b-4c9f-4ff0-af64-a46b7142994b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.211947 Jun 15 10:27:14.741713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 344/684] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:15.449261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:15.449900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:15.452357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:15.459181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.459626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.460422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.460857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.557392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:15.558326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:15.560992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:15.568797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.569300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.570107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.570545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.638933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:15.652825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a61f8cae-84d3-446d-9e0f-b96b03e11627 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.207397 Jun 15 10:27:15.654134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 341/685] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:15 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:15.730514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:15.740874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79102c9e-5b1e-403f-9779-868870a3ea69 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.188295 Jun 15 10:27:15.741599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 345/686] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:15 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:15.760208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:15.760992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:15.768080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.768526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.769683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:15.769836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:15.931551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:15.941183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:15.942774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:15.943903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ffdf407-b703-4103-9986-0e45dfe5340d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.187710 Jun 15 10:27:15.944473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 342/687] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:16.709470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:16.710465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:16.746912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:16.756249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:16.758142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:16.764094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:16.766081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:16.782879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:16.795347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:16.812775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:16.817741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:16.820620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:16.821477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:17.168352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:17.179783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5480bf94-1bf9-40a3-a11d-e95484bba720 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.498580 Jun 15 10:27:17.180765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 346/688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:16 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:17.186671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-07bee5f7-e92f-417d-b1d8-40c4b3d7f7ab req-730d8b23-79fb-47ab-adfd-08456ba8574b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "name": "network-vif-unplugged", "status": "completed", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:17.196410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-07bee5f7-e92f-417d-b1d8-40c4b3d7f7ab req-730d8b23-79fb-47ab-adfd-08456ba8574b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:17.197192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-07bee5f7-e92f-417d-b1d8-40c4b3d7f7ab req-730d8b23-79fb-47ab-adfd-08456ba8574b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:17.225140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-07bee5f7-e92f-417d-b1d8-40c4b3d7f7ab req-730d8b23-79fb-47ab-adfd-08456ba8574b service nova] Creating event network-vif-unplugged:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:27:17.232007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-07bee5f7-e92f-417d-b1d8-40c4b3d7f7ab req-730d8b23-79fb-47ab-adfd-08456ba8574b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049603 Jun 15 10:27:17.237701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 347/689] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:27:17.245590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:17.246825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:17.255233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:17.255695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:17.256553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:17.257072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:17.378246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:17.406851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b7460ff-e899-4134-99ee-9cb3a28b27f8 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.648412 Jun 15 10:27:17.420999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 343/690] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:16 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:17.420999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1168901736", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "networks": [{"uuid": "266bebcb-4e19-4f89-86c2-cbc1186aab2d"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:17.448616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:17.478472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:17.489412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:17.490968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f01f07bb-733a-41e6-8bd2-bfcf86b83b73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1721 microversion: 2.20 time: 0.251620 Jun 15 10:27:17.491820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] validate_networks() for [('266bebcb-4e19-4f89-86c2-cbc1186aab2d', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:27:17.492233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 348/691] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:17.580841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b31b6ca1-2370-4940-ae11-6851eb2f1c0a req-15ad56c7-31dc-47d6-89bd-926dffae2faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390211db-fa77-4ef4-849f-3ecb9e9f9d12", "tag": "93857ab5-043b-4153-ace5-d3c630dc4bef"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:17.592477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b31b6ca1-2370-4940-ae11-6851eb2f1c0a req-15ad56c7-31dc-47d6-89bd-926dffae2faa service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:17.593245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b31b6ca1-2370-4940-ae11-6851eb2f1c0a req-15ad56c7-31dc-47d6-89bd-926dffae2faa service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:17.608420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b31b6ca1-2370-4940-ae11-6851eb2f1c0a req-15ad56c7-31dc-47d6-89bd-926dffae2faa service nova] Creating event network-changed:93857ab5-043b-4153-ace5-d3c630dc4bef for instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 on hv-cinder-84580 Jun 15 10:27:17.614542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b31b6ca1-2370-4940-ae11-6851eb2f1c0a req-15ad56c7-31dc-47d6-89bd-926dffae2faa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120912 Jun 15 10:27:17.615220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 349/692] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:27:18.090738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:27:18.091234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:27:18.091629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:27:18.092038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:27:18.092448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:27:18.103740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.104184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.105023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.105474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.124523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Getting quotas for project 40cd185858444d8aaf78e72a740b624f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:27:18.130075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Getting quotas for user 80a318aa610e449fb6e480372ee61db8 and project 40cd185858444d8aaf78e72a740b624f. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:27:18.145501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:27:18.147872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:27:18.201015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:18.201757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:18.208744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.209189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.209976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.210416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.276005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ba84170-34b1-4003-80e5-ac4fc082f367 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.865375 Jun 15 10:27:18.276617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 344/693] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:27:18.290696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-728e3d86-e806-4bf8-b094-e3b7a21780c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:18.291562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-728e3d86-e806-4bf8-b094-e3b7a21780c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:18.372168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-728e3d86-e806-4bf8-b094-e3b7a21780c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.385953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-728e3d86-e806-4bf8-b094-e3b7a21780c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1219 microversion: 2.1 time: 0.098853 Jun 15 10:27:18.387151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 345/694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:18.399966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.410573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-08f18fef-d2cf-4c9e-b706-7ba60d8bddf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.213915 Jun 15 10:27:18.411162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 350/695] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:18 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:18.439357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:18.440581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:18.453102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.454039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.455835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.456471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.528734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:18.529684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:18.544408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.544869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.545767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.546512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.680413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.693401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-55bfb699-fe19-4d06-b1e0-45ded2646a29 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.260122 Jun 15 10:27:18.694447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 346/696] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:18 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:18.742924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.751841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.753659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:18.754932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-580c6d66-25c7-4384-91cc-1ad8d0e5ba64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1724 microversion: 2.20 time: 0.234581 Jun 15 10:27:18.755597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 351/697] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:18.780695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61ea3ed6-c3cc-4fd4-a89d-de3fba779525"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:18.781887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:18.784679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:18.790273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.790458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:18.791238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:18.791684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.416384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:19.417857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:19.431053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.431825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.433239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.434054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.556876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:19.563496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:19.573359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-81bce91b-b9d5-4f58-ac17-14d55aee4a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1223 microversion: 2.1 time: 0.164785 Jun 15 10:27:19.574440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 352/698] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:19.584445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:19.585573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:19.596908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.597248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.598247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.598817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.778860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:19.793293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93daad5b-4a7d-4249-b6e2-dfc4ce41a416 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1267 microversion: 2.1 time: 0.212710 Jun 15 10:27:19.793293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 353/699] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:19 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:19.798312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:19.799429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:19.809822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.810483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.811904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:19.812592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:19.995300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:20.005753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae496596-e456-429b-8eca-7b7652e7d33b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.214225 Jun 15 10:27:20.012722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 354/700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:19 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:20.133868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c3d9fba-ab39-4b52-9b58-50ad5f0919a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.357160 Jun 15 10:27:20.134741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 347/701] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Jun 15 10:27:18 2022] POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 188 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:27:20.270021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:20.270722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:20.285430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.286328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.287760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.288527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.596786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:20.597638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:20.605446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.605903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.606733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.607168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.667567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ad5609b-f63e-42da-9e1b-dc3395b9224d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action" status: 202 len: 0 microversion: 2.20 time: 0.401901 Jun 15 10:27:20.668564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 355/702] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Jun 15 10:27:20 2022] POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:27:20.685194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:20.686713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:20.692845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:20.702617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.703112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:20.704424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.707219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.708342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.717393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0b44b77-cdd1-48ed-a9a2-a0ad3b64e275 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1215 microversion: 2.1 time: 0.125011 Jun 15 10:27:20.719395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 348/703] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:20.811071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:20.811878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:20.820901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.822104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.823283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:20.823914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:20.944490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:20.956277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:20.958072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:20.959347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ec681e8a-c380-433a-8fc8-3101b32edb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1750 microversion: 2.20 time: 0.283409 Jun 15 10:27:20.959926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 356/704] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:21.029923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:21.031201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:21.040133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.040675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.041585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.042102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.059496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:21.071985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-88475657-09cf-4c21-9096-63068e0950fb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1453 microversion: 2.1 time: 0.265755 Jun 15 10:27:21.072796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 349/705] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:20 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1453 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:21.105582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:21.107217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:21.120350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.121911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.126342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.128035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.249634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:21.265280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be0f32b5-2c2f-4f80-81d9-22514e2adc2d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.243527 Jun 15 10:27:21.266344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 357/706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:21 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:21.323555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:21.333922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fe8317dd-32d1-4dc7-a6ea-68c55bccfef6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1453 microversion: 2.1 time: 0.240418 Jun 15 10:27:21.340418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 350/707] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:21 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:21.753844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:21.754955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:21.769778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.775421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.775421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:21.775421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:21.895967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:21.923015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b61ab498-6cb6-46df-ab85-8a4d5f297e49 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1215 microversion: 2.1 time: 0.177255 Jun 15 10:27:21.928208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 358/708] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:21.987946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:21.989275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:22.000445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.001462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:22.004180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.008929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:22.038116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:22.276847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:22.288318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:22.289962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:22.291221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a98c399-2311-4b7d-9401-2b9027df2d71 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1750 microversion: 2.20 time: 0.308361 Jun 15 10:27:22.292950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:22.293801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:22.302195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.302911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:22.304200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.304746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:22.305567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 351/709] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1750 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:22.562127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:22.571611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43b1936a-9220-43ec-8042-e99b44984098 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.283151 Jun 15 10:27:22.572283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 359/710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:22 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:22.951910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:22.953108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:22.961156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.961942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:22.964123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:22.965216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:23.120886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:23.120886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b2479ed-1e6d-48b4-b68c-c1dd50420ac0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1215 microversion: 2.1 time: 0.142002 Jun 15 10:27:23.120886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 352/711] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:23.311185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:23.312149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:23.319440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:23.319891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:23.322536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:23.322536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:23.478699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:23.487702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:23.488851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:23.490174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74ca174d-1a35-4eb3-8046-17ba826617bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1750 microversion: 2.20 time: 0.183088 Jun 15 10:27:23.490723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 360/712] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:23.591091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:23.591956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:23.598802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:23.599242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:23.600070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:23.600517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.099542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:24.114533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c3b175d-607d-4ff1-b065-cc595d056a1a tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.527061 Jun 15 10:27:24.122591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 353/713] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:23 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:24.135983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:24.139036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:24.146571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:24.147321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.148910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:24.151283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.263401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:24.276364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7c053340-6b3a-4c76-8ca8-db07d0cc5a62 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1271 microversion: 2.1 time: 0.148831 Jun 15 10:27:24.277357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 361/714] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:24.518502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:24.519778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:24.533909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:24.539152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.539152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:24.539152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.720345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-afb062af-4f02-4135-9d7e-7fb15df37f17 req-4df050fd-9d34-4092-a990-18eb59cecb82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd0d535-7284-4990-a7aa-9cb616268d39", "tag": "9efed795-e65a-463e-9459-226eeae54890"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:24.757457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-afb062af-4f02-4135-9d7e-7fb15df37f17 req-4df050fd-9d34-4092-a990-18eb59cecb82 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:24.758242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-afb062af-4f02-4135-9d7e-7fb15df37f17 req-4df050fd-9d34-4092-a990-18eb59cecb82 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:24.811626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-afb062af-4f02-4135-9d7e-7fb15df37f17 req-4df050fd-9d34-4092-a990-18eb59cecb82 service nova] Creating event network-changed:9efed795-e65a-463e-9459-226eeae54890 for instance 1bd0d535-7284-4990-a7aa-9cb616268d39 on hv-cinder-84580 Jun 15 10:27:24.823095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-afb062af-4f02-4135-9d7e-7fb15df37f17 req-4df050fd-9d34-4092-a990-18eb59cecb82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113089 Jun 15 10:27:24.825164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 362/715] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:27:24.862485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:24.881975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:24.886164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:24.890295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b764667-2e2b-48a9-8f91-18a4fae237f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1752 microversion: 2.20 time: 0.381323 Jun 15 10:27:24.893702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 354/716] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1752 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:25.145456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:25.146830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:25.165027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.165559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:25.166398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.166842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:25.307478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:25.312738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:25.335422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.341005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:25.342859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.350348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:25.514747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:25.563817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ccc67290-3c6c-496c-b4f1-bdbec575bd5b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.427021 Jun 15 10:27:25.583433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 363/717] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:25 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:25.627866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:25.638648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ad65db2-e33d-40f9-95b9-5571fc0e2b74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1289 microversion: 2.1 time: 0.339257 Jun 15 10:27:25.656344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 355/718] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:25 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1289 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:25.918440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:25.920731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:25.934235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.940546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:25.940546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:25.940546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:26.203495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:26.232126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:26.237336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:26.240214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e6623c3-78b1-4251-8153-76112b6ba90a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1752 microversion: 2.20 time: 0.329645 Jun 15 10:27:26.254914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 364/719] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1752 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:26.589250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:26.590216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:26.602023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:26.604040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:26.604040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:26.604433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:26.670777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:26.671991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:26.685632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:26.686695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:26.688314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:26.689183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:26.878075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:26.881387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:26.888416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1842665-91a5-479a-83b3-c7391bceee28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.223536 Jun 15 10:27:26.889810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 365/720] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:26.890038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e887cb9f-3dfe-4483-9b7b-2759ad308809 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.305581 Jun 15 10:27:26.891051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 356/721] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:26 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:27.273324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:27.274199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:27.283003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.283702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:27.284859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.285701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:27.467251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:27.478621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:27.480587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:27.482047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6dab188-15d9-43d9-b591-3ba9bce85d1d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.215288 Jun 15 10:27:27.482730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 366/722] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:27.918962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:27.919808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:27.920684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:27.921900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:27.935166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.936058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:27.938046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.938337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.939198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:27.939698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:27.943094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:27.944554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:28.114855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:28.167704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:28.183192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e9a3222-024b-4727-8ee1-2463e5be2a14 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.270801 Jun 15 10:27:28.184680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 367/723] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:27 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:28.195266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-8406f539-12e9-4385-8039-73615181a60a req-e64b69f6-cbbe-4cc5-899c-5de26fac797c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390211db-fa77-4ef4-849f-3ecb9e9f9d12", "name": "network-vif-plugged", "status": "completed", "tag": "93857ab5-043b-4153-ace5-d3c630dc4bef"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:28.211729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8406f539-12e9-4385-8039-73615181a60a req-e64b69f6-cbbe-4cc5-899c-5de26fac797c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:28.212777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8406f539-12e9-4385-8039-73615181a60a req-e64b69f6-cbbe-4cc5-899c-5de26fac797c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:28.234895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-8406f539-12e9-4385-8039-73615181a60a req-e64b69f6-cbbe-4cc5-899c-5de26fac797c service nova] Creating event network-vif-plugged:93857ab5-043b-4153-ace5-d3c630dc4bef for instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 on hv-cinder-84580 Jun 15 10:27:28.244499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-8406f539-12e9-4385-8039-73615181a60a req-e64b69f6-cbbe-4cc5-899c-5de26fac797c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056476 Jun 15 10:27:28.245665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 368/724] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:27:28.379358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:28.477886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:28.486993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4d35a69-29da-40f5-be83-9a2f56566f09 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.575325 Jun 15 10:27:28.487796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 357/725] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:28.505043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:28.505933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:28.516566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:28.516566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:28.516566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:28.516566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:28.647183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-19d24f0f-10c1-4056-8b04-8394d13b74d1 req-f23d944b-c30d-4046-afc3-caa3e1d42413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7caeb5-c9cc-493c-94d7-cac63be29ff2", "tag": "3f207246-b0bf-4941-9c5b-903c2361d2dc"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:27:28.657498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-19d24f0f-10c1-4056-8b04-8394d13b74d1 req-f23d944b-c30d-4046-afc3-caa3e1d42413 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:28.661782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-19d24f0f-10c1-4056-8b04-8394d13b74d1 req-f23d944b-c30d-4046-afc3-caa3e1d42413 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:28.681986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-19d24f0f-10c1-4056-8b04-8394d13b74d1 req-f23d944b-c30d-4046-afc3-caa3e1d42413 service nova] Creating event network-changed:3f207246-b0bf-4941-9c5b-903c2361d2dc for instance 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 on hv-cinder-84580 Jun 15 10:27:28.689470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-19d24f0f-10c1-4056-8b04-8394d13b74d1 req-f23d944b-c30d-4046-afc3-caa3e1d42413 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054837 Jun 15 10:27:28.691867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 358/726] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:27:28.953099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:28.958234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:28.964647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:28.966258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:28.967528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87c45561-df03-4711-94fe-41f02ef969c0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.468684 Jun 15 10:27:28.968165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 369/727] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:29.206824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:29.207536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:29.215082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.215539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:29.216412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.216847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:29.369443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:29.377973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-980c8cb7-8299-4c18-afba-775492785349 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.175307 Jun 15 10:27:29.378565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 359/728] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:29 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:29.504858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:29.505519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:29.513672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.514100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:29.518157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.518157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:29.668150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:29.678067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f5255ed5-c1b7-48fe-9e5a-fd8941de32d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.177908 Jun 15 10:27:29.678650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 370/729] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:29.988008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:29.988672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:29.995300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.995744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:29.996522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:29.996950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:30.147328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:30.157034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:30.159168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:30.160392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6974db7-7fbd-4cf2-bd70-f1833ed6901c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.177409 Jun 15 10:27:30.160988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 360/730] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:30.396764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:30.397511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:30.405039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:30.405602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:30.406492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:30.406966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:30.574968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:30.587643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb271322-172e-4f3b-a038-bf1b9ce12d6e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.195467 Jun 15 10:27:30.588225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 371/731] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:30 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:30.699116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:30.700192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:30.710094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:30.710543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:30.711320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:30.711823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:30.996693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:31.008094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de6c56e0-af4d-413e-80ac-1ed111ad4af0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.315848 Jun 15 10:27:31.009545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 361/732] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:30 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:31.183309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:31.184318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:31.202935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:31.202935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:31.202935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:31.202935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:31.365475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:31.376786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:31.379689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:31.381097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1317865e-0237-4875-be30-862ab8d0a84f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.204505 Jun 15 10:27:31.381786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 372/733] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:31.606877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:31.607834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:31.615505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:31.616245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:31.617313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:31.617752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:31.833563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:31.844879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-83dff049-63fe-40a8-ab41-90098bc32b7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.241864 Jun 15 10:27:31.849437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 362/734] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:31 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:32.028517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:32.029308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:32.041261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.042105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:32.043041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.043635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:32.241396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:32.249653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7e9ca0d6-1d55-462a-9f70-1b21198e4359 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.225182 Jun 15 10:27:32.250248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 373/735] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:32 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:32.400588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:32.401754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:32.408490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.408939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:32.409776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.410217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:32.596328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:32.606086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:32.607849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:32.609181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e698aa14-a28c-4e5f-8f12-8db734892f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.212680 Jun 15 10:27:32.613229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 363/736] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:32.867902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:32.868454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:32.874913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.875365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:32.876149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:32.876587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:33.026979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:33.037453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ad0c9b39-c72c-4a91-a48e-138062676825 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.173354 Jun 15 10:27:33.038269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 374/737] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:32 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:33.267292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:33.268660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:33.275749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:33.276194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:33.277055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:33.277427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:33.454461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:33.463842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eeb5cdf2-f7e1-499e-92e6-860a7ad3a1db tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.200283 Jun 15 10:27:33.464636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 364/738] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:33.632621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:33.634766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:33.658622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:33.659548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:33.660913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:33.661730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:33.915634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:33.925509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:33.927031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:33.928477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a8a37d3-d7b4-4f2b-a3da-93687e2b661c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.302712 Jun 15 10:27:33.929555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 375/739] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:34.056010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:34.056705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:34.063336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.063774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:34.065409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.065926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:34.242348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:34.254234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-650903af-b2f9-4d74-b3a9-900f1cd0b5a7 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.202003 Jun 15 10:27:34.255545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 365/740] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:34 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:34.484023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:34.484843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:34.492723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.493204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:34.493990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.494649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:34.712709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:34.723721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9319d379-2f63-4af1-893b-daa94bb34846 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.244672 Jun 15 10:27:34.724655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 376/741] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:34.957904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:34.958546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:34.966129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.966590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:34.967384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:34.967824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:35.158005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:35.172591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:35.176584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:35.178772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cbc38f43-a91b-44ab-b8f4-d0f43a4c105d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.226046 Jun 15 10:27:35.179800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 366/742] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:35.275002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:35.275523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:35.282917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:35.284159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:35.285146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:35.285732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:35.475570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:35.493692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c69dedc1-8230-4114-99ee-816c658c8c9b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.222041 Jun 15 10:27:35.505959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 377/743] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:35 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:35.742971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:35.743651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:35.750672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:35.751248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:35.752553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:35.753017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:35.923918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:35.934535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b70f6a5-7669-4592-97e1-2ab37370bf1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.195518 Jun 15 10:27:35.935612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 367/744] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:36.203621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:36.205893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:36.217275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.218042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:36.219415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.220216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:36.442020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:36.455764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:36.458293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:36.459615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f514e74d-5ccb-436f-94af-17b13b0afcc7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.263725 Jun 15 10:27:36.460197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 378/745] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:36.518651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:36.519379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:36.526822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.527385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:36.528267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.528805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:36.721293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:36.725183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:36.730013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b529ea0-c0f4-4ffe-a80c-8fa63f5fc829 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.215822 Jun 15 10:27:36.730821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 368/746] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:36 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:36.964999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:36.966072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:36.976788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.977264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:36.978097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:36.978558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:37.164403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:37.179690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9458dbe-20fe-4890-a490-1f4049c07752 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.221679 Jun 15 10:27:37.180720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 379/747] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:37.479017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:37.479631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:37.487556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:37.488014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:37.488820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:37.489286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:37.666675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:37.676324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:37.677849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:37.679040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ac2988e-4723-44a2-9469-b8c1c03fdf0a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.204608 Jun 15 10:27:37.679656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 369/748] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:37.748014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:37.748687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:37.755673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:37.756188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:37.757012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:37.757452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:37.931598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:37.943421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-59686750-fb6f-45d3-8c52-fdeba9d82c4d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.199508 Jun 15 10:27:37.944161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 380/749] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:37 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:38.203138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:38.203752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:38.211409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.211811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:38.212601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.213180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:38.368034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:38.378617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa503c3e-811a-4c7a-8732-ccdecf2457d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.179908 Jun 15 10:27:38.379502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 370/750] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:38 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:38.700056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:38.701210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:38.713900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.714875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:38.716115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.716904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:38.890548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:38.906034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:38.907979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:38.910838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7b21883-8d7d-4747-8909-81c86acd1e27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.216249 Jun 15 10:27:38.915707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 381/751] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:38.964155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:38.964910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:38.976189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.976917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:38.978230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:38.978958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:39.167731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:39.180056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66979c6e-ce30-42e3-92b3-41c2034360bc tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.221248 Jun 15 10:27:39.181349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 371/752] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:38 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:39.397161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:39.397699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:39.404445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:39.404895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:39.405728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:39.406200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:39.584010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:39.592786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf6417ed-95ec-4db1-a67a-9324e26a4b6f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.200597 Jun 15 10:27:39.603821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 382/753] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:39.936308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:39.938216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:39.948729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:39.949480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:39.950549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:39.951095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:40.107323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:40.123194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:40.126381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:40.128676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8194503-124d-4849-9edd-835fc6423deb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.199749 Jun 15 10:27:40.129686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 372/754] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:40.204898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:40.207152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:40.218132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:40.218582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:40.219395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:40.219838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:40.380230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:40.389040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d30ffd1-3dab-4cae-b2eb-6b25b71a6bed tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.194789 Jun 15 10:27:40.389645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 383/755] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:40 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:40.614062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:40.614681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:40.621567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:40.622975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:40.622975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:40.623342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:40.800430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:40.809679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6af8bc18-e009-448b-9ad7-2b117844c236 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.200280 Jun 15 10:27:40.810549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 373/756] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:41.154372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:41.155510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:41.166162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.166665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:41.167623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.168160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:41.394966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:41.406894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:41.408708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:41.410056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-02fabd1c-8107-4a53-89c3-39d7fabbe888 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.263145 Jun 15 10:27:41.410724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 384/757] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:41.411136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:41.412503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:41.425938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.426838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:41.428281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.429271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:41.637304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:41.646975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e14e11b7-d886-4a2a-b992-74cb817aba0d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.243006 Jun 15 10:27:41.647674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 374/758] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:41 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:41.829145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:41.829773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:41.838144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.838704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:41.839623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:41.840410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:42.034441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:42.043396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-caa1ed08-c1dd-4804-a9ab-a138df75fc2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.218792 Jun 15 10:27:42.043987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 385/759] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:42.431066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:42.431755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:42.441457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:42.441903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:42.442698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:42.443130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:42.615568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:42.624920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:42.626441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:42.628164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47505503-6580-431b-be7e-9946cbf813b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.201453 Jun 15 10:27:42.628938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 375/760] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:42.667888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:42.669096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:42.680848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:42.681584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:42.682342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:42.682772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:42.706406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:42.840435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:42.849805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-547e33e8-8771-46be-94f9-654306d3e351 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.187539 Jun 15 10:27:42.850423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 386/761] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:42 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:43.073244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:43.074033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:43.081728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.082174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:43.082975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.083408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:43.276670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:43.291447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-28d17cfb-8c85-4954-b11c-35b19f49c329 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.225025 Jun 15 10:27:43.292284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 376/762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:43 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:43.649828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:43.650434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:43.657991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.658831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:43.659943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.660472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:43.840044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:43.873283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:43.875604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:43.877930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:43.880054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:43.882421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70411ff5-ab30-4bf7-af09-098fe7f7ffa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.236486 Jun 15 10:27:43.883632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 387/763] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:43.897632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.898139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:43.899146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:43.899730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:44.072765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:44.082877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d420521d-e06c-48b5-bb89-5ea2b0f457f3 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.218415 Jun 15 10:27:44.083788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 377/764] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:43 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:44.318140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:44.318713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:44.325885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:44.326517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:44.327429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:44.328163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:44.527473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:44.537941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65e495c7-a07d-45e5-a3e3-56bf3ece3d28 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.224696 Jun 15 10:27:44.541032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 388/765] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:44.904402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:44.905454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:44.913476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:44.914049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:44.915610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:44.916172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:45.101652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:45.102273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:45.104677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:45.109402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:45.109928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:45.111075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:45.112734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:45.123753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:45.127347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:45.129790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3dca7cbd-9df0-4b6c-a710-05fd0729a559 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.229613 Jun 15 10:27:45.130871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 378/766] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:45.291017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:45.300603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-949724c8-c852-4c0e-9396-f028195709d6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.203643 Jun 15 10:27:45.304405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 389/767] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:45 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:45.565121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:45.566551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:45.577422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:45.578493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:45.579919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:45.582333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:45.756098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:45.764732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13b18bef-d98e-4009-a3e7-09ec5bc17238 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.207710 Jun 15 10:27:45.765434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 379/768] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:45 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:46.160052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:46.160917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:46.171159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.171936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.173328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.175074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.319345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:46.320148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:46.327789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.328490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.329321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.329762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.370767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:46.386475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:46.389974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:46.391854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-291b35e4-8eed-4788-9157-4d754d84a1a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.235698 Jun 15 10:27:46.394179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 390/769] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:46.507380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:46.515625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1a44495-2d92-4a39-9c6e-9ea20c2b2f7e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.201315 Jun 15 10:27:46.518687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 380/770] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:46 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:46.782573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:46.783953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:46.790617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.791066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.791841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:46.792503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:46.957047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:46.962262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dde27557-1e0d-4508-8972-e458d661fe1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.183361 Jun 15 10:27:46.962874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 391/771] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:47.414650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:47.415304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:47.422493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.422940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:47.424211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.424645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:47.554862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:47.556016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:47.572667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.573502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:47.580977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.580977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:47.590613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:47.603413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:47.605358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:47.607683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e960f8a1-e5bb-437e-8616-c0d52bebecd8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.196916 Jun 15 10:27:47.619670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 381/772] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:47.756658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:47.765521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21a744d2-ac1d-4a31-92b9-4cbbbe5e8356 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.219236 Jun 15 10:27:47.766189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 392/773] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:47 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:47.980419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:47.981228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:47.987853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.991713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:47.991713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:47.991713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:48.148041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:48.156990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8552a43-3cb1-4d05-972c-3c30b936f936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.180669 Jun 15 10:27:48.157597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 382/774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:48.636468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:48.637199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:48.645529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:48.646035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:48.646876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:48.647346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:48.788686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:48.789944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:48.802586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:48.803380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:48.804748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:48.805176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:48.805578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:48.822144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:48.825240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:48.827499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe437298-35b8-4d6a-b13a-251793802b35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.195216 Jun 15 10:27:48.828797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 393/775] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:48.997500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:49.006951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2d86b66-17b6-43ca-b619-66fd15ccabd6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.225828 Jun 15 10:27:49.007545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 383/776] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:48 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:49.176655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:49.177291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:49.184609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:49.185087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:49.185874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:49.186300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:49.343246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:49.353366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6d9ea52-e27a-41f5-9b22-59cc83959e44 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.181959 Jun 15 10:27:49.353962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 394/777] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:49 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:49.857495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:49.858362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:49.860476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=74 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:49.866179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:49.866617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:49.867396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:49.867828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:50.028761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:50.029784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:50.041810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:50.042562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:50.043905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:50.044612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:50.045333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:50.055664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:50.057658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:50.059141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13bd8db3-733c-4dc2-8ccd-e39bb43de4f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.205891 Jun 15 10:27:50.059969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 384/778] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:50.227475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:50.235562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f770a84-6667-4bf7-891b-d32fa58e1a36 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.213766 Jun 15 10:27:50.236160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 395/779] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:50 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:50.371955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:50.372483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:50.380254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:50.380701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:50.381511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:50.381935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:50.402916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:50.533094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:50.543001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e255fd7-3243-4cb5-87fb-c08fa4c348e6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.174891 Jun 15 10:27:50.543596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 385/780] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:50 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:50.732565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:27:50.732792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:27:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:27:51.079510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:51.080394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:51.083409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=80 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:51.088774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.088774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.096456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.096456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.245090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:51.254405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:51.255033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:51.256409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:51.258038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:51.259255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b135e4a2-b993-4f8b-9c4f-32010d090928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.184390 Jun 15 10:27:51.259873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 396/781] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:51.262482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.262956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.263714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.264145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.412817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:51.421095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2fe7c1dd-dffd-44d6-9031-42fa9e8fb71e tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.170768 Jun 15 10:27:51.421865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 386/782] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:51 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:51.562445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:51.563054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:51.570676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.571118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.571916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:51.572343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:51.728595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:51.740946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c6d41c64-0fef-44b9-8be3-7aec1ffd15d4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.182356 Jun 15 10:27:51.741928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 397/783] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:52.278839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:52.279505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:52.287968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.288409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.289258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.289692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.445646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:52.446919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:52.460520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.461348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.462768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.463552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.466675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:52.480673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:52.484318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:52.490613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5e4de3ec-1dd8-45b6-862b-8c3063f52bcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.210783 Jun 15 10:27:52.490613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 387/784] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:52.670042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:52.680451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d1b7829-56a8-4679-9b20-7007c714329f tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1315 microversion: 2.1 time: 0.243165 Jun 15 10:27:52.686352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 398/785] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:52 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:52.760818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:52.761757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:52.769176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.769634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.770461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:52.770886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:52.938216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:52.949537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dce973fa-5598-47a8-9631-42ee1c6c3b5e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.193184 Jun 15 10:27:52.950168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 388/786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:53.505448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:53.506149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:53.515241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.515694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:53.516559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.517033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:53.676917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:53.686271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:53.687852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:53.689075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5864d948-b921-4a5e-bb23-882f450e4544 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.188822 Jun 15 10:27:53.690286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 399/787] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:53.698417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:53.699301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:53.708350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.708786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:53.709612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.710045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:53.916354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:53.927677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04e8eb1e-b8a0-4341-a436-5e25599584ad tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1465 microversion: 2.1 time: 0.233125 Jun 15 10:27:53.928793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 389/788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:53 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1465 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:53.970207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:53.972081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:53.981400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.981843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:53.982685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:53.986035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.000414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:54.001362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:54.013079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.013896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.015328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.016217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.067635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:27:54.166486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:54.176123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f6c5996-7ddd-41ef-a9bc-02f62568eb9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.210537 Jun 15 10:27:54.177133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 400/789] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:54.653006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b275be0-5d8b-4306-902b-1f5166dc9982 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "DELETE /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 204 len: 0 microversion: 2.1 time: 0.660241 Jun 15 10:27:54.657913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 390/790] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:27:53 2022] DELETE /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:27:54.704630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:54.704630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:54.704630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.704630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.707620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.707620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.714992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:54.716226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:54.724612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.725206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.726296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:54.726833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:54.880693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:54.894713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-011f3e99-a9df-4992-943a-0e392230450b tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.235092 Jun 15 10:27:54.895319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 401/791] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:54 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:54.930399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:54.939094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:54.971502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:54.971502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22d6edee-d06b-4357-8a8a-72c93d23dc82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.232967 Jun 15 10:27:54.971502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 391/792] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:27:55.198010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:55.198788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:55.207474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.207958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.208751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.209226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.359359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:55.367450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fd44ae47-5926-4bc1-bde9-7dd66d01f7b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.174466 Jun 15 10:27:55.368017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 402/793] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:55.915770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:55.916316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:55.923461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.923901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.924789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.925256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.964838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:55.966125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:55.978230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.979375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.980518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:55.981343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:55.990157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:56.115566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:56.126348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13216efa-cf31-447c-b679-cd99ca5cfa46 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.214631 Jun 15 10:27:56.127326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 392/794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:55 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:56.177007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:56.186509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:56.188025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:56.189858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6bc621ee-84ce-4008-85e9-8c078555ea83 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.231200 Jun 15 10:27:56.190510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 403/795] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:56.386470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:56.387092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:56.394957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:56.395419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:56.396223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:56.396659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:56.574022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:56.582723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-421fbbeb-ebd9-470f-9882-3da80ac19e01 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.200199 Jun 15 10:27:56.583601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 393/796] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:57.146698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:57.147431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:57.154900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.155339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.156113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.156541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.211447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:57.212157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:57.219185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.219727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.221757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.222016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.332922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:57.341442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf8f7c9c-d537-4d38-ad14-d61c9795345d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.199909 Jun 15 10:27:57.342292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 404/797] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:57 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:57.371141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:57.380689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:57.382208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:57.383464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dbbe8106-cee4-4c18-86c0-a3af72464648 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.176045 Jun 15 10:27:57.384031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 394/798] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:57.601342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:57.601959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:57.608516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.608992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.609791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:57.610235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:57.765296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:57.774222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3b1372f-1a82-4e28-abf3-4a7589d3a3c8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.176819 Jun 15 10:27:57.774805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 405/799] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:57 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:58.360776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:58.361444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:58.368792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.369416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.370219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.370649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.404446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:58.405347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:58.416362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.417126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.417975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.418443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.528750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:58.537046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0352d171-b60f-474b-9fd2-e5b60fcc5c2c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.179962 Jun 15 10:27:58.537666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 395/800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:58 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:58.608349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:58.618232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:58.619622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:58.620787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc987809-9237-425c-92fc-e7103f1c8cb3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.220562 Jun 15 10:27:58.621373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 406/801] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:27:58.792409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:58.793156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:58.800163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.800621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.801457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:58.801898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:58.983395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:58.991530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eef16007-3702-4c9e-91e1-374f54a51c52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.203610 Jun 15 10:27:58.992123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 396/802] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:27:59.556280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:59.557077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:59.565271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:59.565988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:59.566992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:59.567427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:59.640611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:27:59.641592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:27:59.651725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:59.652319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:59.653416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:27:59.654044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:27:59.755573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:59.766219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-96f78715-c945-4544-bec7-b9ee6ab8c6f6 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.214309 Jun 15 10:27:59.766882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 407/803] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:27:59 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:27:59.828712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:59.839331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:59.840876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:27:59.842136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-410ceb53-888f-4364-a592-cf575856e7a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.206027 Jun 15 10:27:59.842710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 397/804] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:27:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:00.009699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:00.010293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:00.016431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.016877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:00.019054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.019497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:00.360534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:00.368607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc15b817-4177-4939-9533-6aee2612b199 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.362881 Jun 15 10:28:00.369151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 408/805] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:00.792056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:00.792790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:00.803447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.803994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:00.804928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.805457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:00.864441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:00.865789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:00.874310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.875348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:00.876444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:00.877342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:01.103869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:01.123049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:01.126652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:01.130799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-57c2a396-2ded-4569-b7c0-6b6048899635 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.271837 Jun 15 10:28:01.132100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 409/806] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:01.225256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:01.238643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b66bda4-9521-4875-b95a-a116e30399fa tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.450891 Jun 15 10:28:01.239304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 398/807] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:00 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:01.386380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:01.386908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:01.394444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:01.394885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:01.395670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:01.396103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:01.541180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:01.549622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4e192f9-0429-44f1-914e-f687fd3e1271 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.167287 Jun 15 10:28:01.550269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 410/808] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:02.160457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:02.161110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:02.168120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.168569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.169408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.169850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.257958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:02.259007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:02.268543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.269115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.269968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.270489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.316460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:02.326318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:02.327848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:02.329531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cde9f877-f7be-4f4b-9089-50e4747f6fdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.173755 Jun 15 10:28:02.330455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 399/809] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:02.439078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:02.452769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edc5307c-9415-41e3-87ff-bd4be03eea5d tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.200121 Jun 15 10:28:02.454049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 411/810] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:02 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:02.570481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:02.571244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:02.577847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.578291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.579376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.579807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.601613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:02.760382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:02.769755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6311ad76-7d34-4d6c-9d3f-90c329a0f386 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.206866 Jun 15 10:28:02.770341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 400/811] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:02.948512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e888c98e-bcf8-48ba-b6b6-332a5862d0a1 req-a9846266-7c3b-4ebb-ab90-4d6fe47ee5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7caeb5-c9cc-493c-94d7-cac63be29ff2", "name": "network-vif-plugged", "status": "completed", "tag": "3f207246-b0bf-4941-9c5b-903c2361d2dc"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:02.959201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e888c98e-bcf8-48ba-b6b6-332a5862d0a1 req-a9846266-7c3b-4ebb-ab90-4d6fe47ee5d1 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:02.959654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e888c98e-bcf8-48ba-b6b6-332a5862d0a1 req-a9846266-7c3b-4ebb-ab90-4d6fe47ee5d1 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:02.972447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e888c98e-bcf8-48ba-b6b6-332a5862d0a1 req-a9846266-7c3b-4ebb-ab90-4d6fe47ee5d1 service nova] Creating event network-vif-plugged:3f207246-b0bf-4941-9c5b-903c2361d2dc for instance 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 on hv-cinder-84580 Jun 15 10:28:02.978318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e888c98e-bcf8-48ba-b6b6-332a5862d0a1 req-a9846266-7c3b-4ebb-ab90-4d6fe47ee5d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105832 Jun 15 10:28:02.979400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 412/812] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:28:03.361366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:03.363609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:03.376903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.377751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.379971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.381164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.475828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:03.476909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:03.487641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.488289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.489328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.489980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.679368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:03.680028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:03.688681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f039d90b-f064-4b76-b9f1-837d9c396a4c tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1471 microversion: 2.1 time: 0.220266 Jun 15 10:28:03.689857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 413/813] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:03 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:03.693163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:03.695321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:03.697641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7bea69e-6f0b-4aa3-9040-9150d79239ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.344887 Jun 15 10:28:03.698635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 401/814] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:03.807039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:03.807039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:03.809054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.809564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.810421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.810780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.896404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-043036ad-bda5-4c99-9963-ed3ac9ab165c req-2d2b9a20-672d-43de-a01a-3966c6770573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390211db-fa77-4ef4-849f-3ecb9e9f9d12", "name": "network-vif-deleted", "tag": "93857ab5-043b-4153-ace5-d3c630dc4bef"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:03.905361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-043036ad-bda5-4c99-9963-ed3ac9ab165c req-2d2b9a20-672d-43de-a01a-3966c6770573 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:03.906033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-043036ad-bda5-4c99-9963-ed3ac9ab165c req-2d2b9a20-672d-43de-a01a-3966c6770573 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:03.919805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-043036ad-bda5-4c99-9963-ed3ac9ab165c req-2d2b9a20-672d-43de-a01a-3966c6770573 service nova] Creating event network-vif-deleted:93857ab5-043b-4153-ace5-d3c630dc4bef for instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 on hv-cinder-84580 Jun 15 10:28:03.926183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-043036ad-bda5-4c99-9963-ed3ac9ab165c req-2d2b9a20-672d-43de-a01a-3966c6770573 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034419 Jun 15 10:28:03.927479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 402/815] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:28:03.992034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:03.998978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c586bf3a-2f3d-4e58-8650-e6447a18faf3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.204743 Jun 15 10:28:03.999561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 414/816] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:03 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:04.710099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:04.711903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:04.719129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:04.719673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:04.721374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:04.721751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:04.727157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:04.728259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:04.740772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:04.741922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:04.743718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:04.744504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:04.857190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:04.869524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43afc174-5aed-48b5-8f90-67cd2efc6c27 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1300 microversion: 2.1 time: 0.165255 Jun 15 10:28:04.870502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 403/817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:04 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:04.957646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:04.974729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:04.978476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:04.981080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b2fe037a-a802-4d8e-b25f-62fbd0b68dea tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.263691 Jun 15 10:28:04.982282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 415/818] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:05.018115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:05.018993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:05.027013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:05.027620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:05.028528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:05.029184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:05.199566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:05.208951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fcc09220-07d6-4f05-a84d-f0f2ed3e9985 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.196358 Jun 15 10:28:05.209755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 404/819] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:05.890811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:05.891427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:05.902749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:05.903474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:05.905292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:05.905790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:05.943577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:05.944030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:05.944496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lazy-loading 'fault' on Instance uuid 390211db-fa77-4ef4-849f-3ecb9e9f9d12 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:28:05.995449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:06.003949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d8f5a4e6-517c-4089-8f08-674e2885d625 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1305 microversion: 2.1 time: 0.117196 Jun 15 10:28:06.004554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 416/820] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:05 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:06.012144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:06.013338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:06.026114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:06.026893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:06.028242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:06.029131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:06.215546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:06.227452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:06.228066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:06.230547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:06.233762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:06.235465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:06.235842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c84fed59-8e73-4eba-a97e-3c66ae55a4a3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.231063 Jun 15 10:28:06.236227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:06.236929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 405/821] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:06.237386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:06.238151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:06.413560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:06.421387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc3ccffa-1dd3-4e3c-bbdf-93c33b80ee79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1319 microversion: 2.1 time: 0.197657 Jun 15 10:28:06.421963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 417/822] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:07.021818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:07.022526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:07.030707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.031148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.031938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.032367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.072361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.072815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.073311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lazy-loading 'fault' on Instance uuid 390211db-fa77-4ef4-849f-3ecb9e9f9d12 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:28:07.122708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0449a8072f9479d827fb655bb0383e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b2cd6b94be49228fec6c9f92d1ccc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:07.133364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f07ec859-ad7e-4790-afc5-45a74361af97 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 200 len: 1305 microversion: 2.1 time: 0.115068 Jun 15 10:28:07.134026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 406/823] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:07 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 1305 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:07.269169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:07.269916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:07.278742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.279162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.280095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.280636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.443024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:07.444212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:07.452946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.454452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.456984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.457828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.464261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:07.482802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:07.486929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:07.489566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fd787aee-eed8-440f-896c-63f7831e4e67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.227948 Jun 15 10:28:07.490885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 418/824] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:07.526733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-1ec928bd-7d50-47be-b2ad-d8d795b87749 req-e0add8b3-c47d-403f-9ea0-bcdb5b2c64a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "name": "network-vif-plugged", "status": "completed", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:07.545451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1ec928bd-7d50-47be-b2ad-d8d795b87749 req-e0add8b3-c47d-403f-9ea0-bcdb5b2c64a4 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.547602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-1ec928bd-7d50-47be-b2ad-d8d795b87749 req-e0add8b3-c47d-403f-9ea0-bcdb5b2c64a4 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.570746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-1ec928bd-7d50-47be-b2ad-d8d795b87749 req-e0add8b3-c47d-403f-9ea0-bcdb5b2c64a4 service nova] Creating event network-vif-plugged:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:28:07.582577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-1ec928bd-7d50-47be-b2ad-d8d795b87749 req-e0add8b3-c47d-403f-9ea0-bcdb5b2c64a4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062819 Jun 15 10:28:07.584294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 419/825] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:07.713341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:07.728087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa1f832e-deb1-4da1-ade3-cbc4e78672d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1507 microversion: 2.1 time: 0.291843 Jun 15 10:28:07.730694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 407/826] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:07.759093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "787624eb-7198-440c-9d6e-2b274d11c75b", "device": "/dev/sdb"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:07.761185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:07.770682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.771133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.771918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:07.772399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:07.856760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:08.151195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:08.151778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] [instance: 390211db-fa77-4ef4-849f-3ecb9e9f9d12] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:08.159758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:08.160257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:08.161126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:08.161628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:08.181378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] HTTP exception thrown: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Request method failure captured: Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 HTTP/1.1 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbP0dlhU-Ia8Q7LHR8fAfq2VflvUutcIru4aFGGR3lblIlQzeByQ-9-7XfHc0o08kHIKHeWyRadnWunY9Tu45aIVO969RsHjsp_-ENXETtw-O3-Ch0DeHguNRTj-AsNgMr5eqWXnAbr7naEZh_nWpu34H0FGHwlpWIAknPy88zrmZnU Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 57b2cd6b94be49228fec6c9f92d1ccc1 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesNegativeTest-515756477 Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:28:08.184717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57b2cd6b94be49228fec6c9f92d1ccc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/57b2cd6b94be49228fec6c9f92d1ccc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/57b2cd6b94be49228fec6c9f92d1ccc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_57b2cd6b94be49228fec6c9f92d1ccc1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesNegativeTest-515756477 Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 57b2cd6b94be49228fec6c9f92d1ccc1 Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesNegativeTest-515756477 Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesNegativeTest-515756477-project Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: c0449a8072f9479d827fb655bb0383e3 Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesNegativeTest-515756477-project Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. Jun 15 10:28:08.194045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '390211db-fa77-4ef4-849f-3ecb9e9f9d12'} Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:28:08.195596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. Jun 15 10:28:08.200017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:28:08.207583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] Returning 404 to user: Instance 390211db-fa77-4ef4-849f-3ecb9e9f9d12 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:28:08.207583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-232f32be-f114-4a83-9ace-fb641e0d4494 tempest-VolumesNegativeTest-515756477 tempest-VolumesNegativeTest-515756477-project] 10.222.0.60 "GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12" status: 404 len: 111 microversion: 2.1 time: 0.039719 Jun 15 10:28:08.207583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 408/827] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:08 2022] GET /compute/v2.1/servers/390211db-fa77-4ef4-849f-3ecb9e9f9d12 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:28:08.524696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:08.525435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:08.532544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:08.533045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:08.533998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:08.535864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:08.789671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:08.800359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:08.802511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:08.804530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dabae292-3f89-4a97-9a91-6c325f4c3c15 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.283751 Jun 15 10:28:08.805388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 409/828] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:09.235730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a8178a52-77ec-4279-a5d1-b98fe764a708 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "POST /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.482409 Jun 15 10:28:09.237040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 420/829] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:28:07 2022] POST /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments => generated 194 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:09.825187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:09.826080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:09.835221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:09.836572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:09.837992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:09.838890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:10.028949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:10.038252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:10.039737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:10.041114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-060c9195-d8ef-4336-8e6e-df992ab5b181 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.220388 Jun 15 10:28:10.041795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 410/830] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:11.060986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:11.062104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:11.070391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:11.070888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:11.071634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:11.072399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:11.275987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:11.291803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:11.293923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:11.295562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e05656b-7b1e-416e-b609-f48f34ec51ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.239024 Jun 15 10:28:11.297375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 421/831] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:12.317935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:12.318661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:12.326122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:12.326581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:12.327430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:12.327879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:12.498597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:12.516405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:12.520353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:12.522785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ab08295-90c6-4270-9dd2-2bb65994356d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.209234 Jun 15 10:28:12.529125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 411/832] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:13.546974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:13.547744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:13.559987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:13.561259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:13.562510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:13.563339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:13.746697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:13.756812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:13.758402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:13.759620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f2c03241-62cf-4326-a835-307d035f2722 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.216696 Jun 15 10:28:13.760263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 422/833] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:14.779843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:14.780452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:14.787750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:14.788195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:14.789110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:14.789548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:14.987235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:14.996840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:14.998456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:14.999696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52e3a257-8b57-4bdf-90a8-a8bac3432c29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1808 microversion: 2.20 time: 0.224320 Jun 15 10:28:15.000420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 412/834] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:28:16.023646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:16.024238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:16.032150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:16.032600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:16.034820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:16.035297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:16.201191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:16.217978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:16.220025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:16.223308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc6d4200-385e-4b24-91a3-265e0ad7e9e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1795 microversion: 2.20 time: 0.203949 Jun 15 10:28:16.223967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 423/835] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:28:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1795 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:28:21.084898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e928fc4-7a6b-4699-a322-58d655a102b5"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:21.086123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:21.088216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:21.093779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:21.094228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:21.095086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:21.095627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:25.317739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bd04aa16-fbe8-4585-9979-cb801be543ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.520466 Jun 15 10:28:25.318460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 413/836] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:28:20 2022] POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 194 bytes in 4523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:28:38.152893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=57 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:38.153798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:38.283935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:38.284438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:38.291891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:38.292326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:38.293147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:38.293586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:38.385309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lazy-loading 'services' on Instance uuid 7b3a5478-7be1-4af4-913f-48a2c5ee7199 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:28:38.620094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-63086bc5-f20c-41c1-9a6c-e47931c22b02 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments/cbcceb54-4210-4244-baf4-37869c2b6056" status: 202 len: 0 microversion: 2.1 time: 0.472684 Jun 15 10:28:38.620703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 424/837] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:28:38 2022] DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments/cbcceb54-4210-4244-baf4-37869c2b6056 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:28:39.036903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:28:39.037239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:28:54.619031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:54.619974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:54.764162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:54.764766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:54.775709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.776152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:54.776937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.777541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:54.809424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c5741165-dd24-4278-aa9c-f33e7b51b805 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/ips" status: 200 len: 151 microversion: 2.1 time: 0.195857 Jun 15 10:28:54.810215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 414/838] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:28:54 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/ips => generated 151 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:28:54.820236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:54.821395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:54.826240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0b662c-0601-4248-86f0-23c649f3a73b"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:28:54.827978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:54.836498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.837041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:54.838040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.838653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:54.959262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/os-volume_attachments HTTP/1.1 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 74 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:28:54.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volumeAttachment": {"volumeId": "7b0b662c-0601-4248-86f0-23c649f3a73b"}} Jun 15 10:28:54.963526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'cb2f5859-7f7e-4ff6-9489-cf042c8dfe93', 'body': {'volumeAttachment': {'volumeId': '7b0b662c-0601-4248-86f0-23c649f3a73b'}}} Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:28:54.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:28:54.969613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 400 to user: Invalid volume: volume 7b0b662c-0601-4248-86f0-23c649f3a73b is already attached to instances: c4944d55-b710-413e-81ed-24e682fa5479 {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3323c410-0c71-4c36-9c14-69471ee703f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.144031 Jun 15 10:28:54.971147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 425/839] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:28:54 2022] POST /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:28:54.975841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:54.981790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:54.983881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.984343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:54.985293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:54.987081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:55.072327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:28:55.378406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7961aa4f-9138-4e66-a5d3-9c6e369afe45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 204 len: 0 microversion: 2.1 time: 0.408042 Jun 15 10:28:55.379155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 415/840] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:28:54 2022] DELETE /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:28:55.388849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:55.390438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:55.398958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:55.399411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:55.400275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:55.400719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:55.585568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:55.595344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e5fad41b-91aa-4148-9c54-1d752ed600f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.210951 Jun 15 10:28:55.596307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 426/841] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:55 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:28:56.620341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:56.621600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:56.634818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:56.635635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:56.637081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:56.637885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:56.830834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:56.839508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c8204cd-d309-42ff-b67a-ced101500158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.227186 Jun 15 10:28:56.840223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 416/842] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:56 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:57.861160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:57.862178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:57.869787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:57.870233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:57.871036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:57.871481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:58.036572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:58.045098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56a8bf61-b5e9-46d4-b9ed-8a095a599863 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.188158 Jun 15 10:28:58.045695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 427/843] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:57 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:28:59.065104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:28:59.065869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:28:59.073495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:59.073952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:59.074809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:28:59.075250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:28:59.243775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:28:59.255878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-725affe2-b473-4142-9aeb-79009513099d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.195900 Jun 15 10:28:59.258924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 417/844] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:28:59 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:00.277876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:00.278473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:00.286116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:00.286705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:00.287602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:00.288127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:00.436763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:00.444708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a4fb391-b1be-40ad-aa39-e9fd116bed27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.170746 Jun 15 10:29:00.445317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 428/845] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:00 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:01.463566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:01.464328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:01.471901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:01.472346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:01.473195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:01.473642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:01.631389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:01.641717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e57cfc8e-52c6-40de-ac90-8a045e544e47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.182028 Jun 15 10:29:01.643728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 418/846] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:01 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:02.667014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:02.667992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:02.675765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:02.676216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:02.677036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:02.677480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:02.827627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:02.837111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5570888-104b-4492-baf3-d95668514eb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.174792 Jun 15 10:29:02.837773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 429/847] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:02 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:03.858106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:03.859164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:03.870563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:03.871368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:03.872519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:03.873231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:04.055196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:04.063685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b55efc4c-0484-43d4-8632-eee367342289 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.211709 Jun 15 10:29:04.064332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 419/848] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:03 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:05.083095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:05.083675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:05.090829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:05.091260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:05.092043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:05.092476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:05.265313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:05.274653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da3b5b00-a1f5-41f9-a8d2-130f5fbc3ef5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.196917 Jun 15 10:29:05.275231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 430/849] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:05 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:06.293411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:06.294099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:06.302398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:06.302903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:06.303617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:06.304054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:06.500510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:06.509832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41f01c21-8187-4667-8b94-ee9c7e3ee957 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.220428 Jun 15 10:29:06.510577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 420/850] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:06 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:07.528714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:07.536521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:07.537370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:07.537824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:07.538625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:07.539067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:07.696509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:07.706261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b43c356d-db03-40f0-9168-0925834f13db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.181880 Jun 15 10:29:07.707106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 431/851] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:07 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:08.724224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:08.724927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:08.734583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:08.735021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:08.736678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:08.737162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:08.888743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:08.896744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20f766db-d566-497a-9db1-45d0fd92ae25 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.176445 Jun 15 10:29:08.897464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 421/852] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:08 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:09.914885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:09.915452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:09.922790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:09.923767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:09.924573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:09.925079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:10.083589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:10.098051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f139e719-71f9-48cf-a130-7ba523a768cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.186769 Jun 15 10:29:10.099132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 432/853] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:09 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:11.127752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:11.128400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:11.135577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:11.136016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:11.136799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:11.137383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:11.292301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:11.301120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-973c8701-7e0e-475b-a189-c26b2c4060c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.178368 Jun 15 10:29:11.301704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 422/854] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:11 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:12.318879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:12.319892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:12.327578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:12.328119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:12.328950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:12.330029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:12.482977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:12.492132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa6a96e1-4000-4e5e-9193-63b5ac6d5195 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.177653 Jun 15 10:29:12.492943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 433/855] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:12 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:13.512301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:13.513328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:13.521347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:13.521806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:13.522615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:13.523060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:13.691132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:13.700158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-79d5e2fa-436e-470c-8f6b-eeb0a97e3e4d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.192127 Jun 15 10:29:13.701053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 423/856] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:13 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:14.722028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:14.722710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:14.729992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:14.730581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:14.731630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:14.732164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:14.878874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:14.887354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ec5b2ae-37c0-4bc8-b666-c9e16530c20d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.170180 Jun 15 10:29:14.887933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 434/857] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:14 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:15.907790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:15.908721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:15.915707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:15.916151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:15.916938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:15.917548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:16.076688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:16.085188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd78a50e-76b8-4b4b-8f11-4fa7cab15e15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.181361 Jun 15 10:29:16.085774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 424/858] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:15 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:17.103509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:17.104130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:17.112019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:17.112851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:17.113705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:17.116913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:17.270797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:17.279626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9c597257-089d-4d8a-a531-1b1afdbe140a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.179986 Jun 15 10:29:17.280206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 435/859] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:17 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:18.299958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:18.300658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:18.308018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:18.308489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:18.309307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:18.309742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:18.458589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:18.467318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4feb1bb6-02f7-4eca-82b0-798cee02e335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.172690 Jun 15 10:29:18.467991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 425/860] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:18 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:19.488410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:19.489403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:19.496783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:19.497382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:19.498176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:19.498605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:19.652737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:19.661964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1fa907df-f617-4d30-85b7-308717833843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.179331 Jun 15 10:29:19.662613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 436/861] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:19 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:19.932810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:29:19.933475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:19.940708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:19.941183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:19.941964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:19.942497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:19.968943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lazy-loading 'flavor' on Instance uuid 900487d3-db1b-4eee-8345-bdbe9e61a352 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:29:20.311652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17d312da-e15d-465f-bf8d-d856dcb9219a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "POST /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352/action" status: 202 len: 0 microversion: 2.1 time: 0.382821 Jun 15 10:29:20.312262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 426/862] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:29:19 2022] POST /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:29:20.321575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:20.322459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:20.328998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:20.330863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:20.331654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:20.332099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:20.487755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:20.496759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-550998a1-4b61-47c6-a3db-438a0be56f88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179124 Jun 15 10:29:20.498987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 437/863] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:20.681864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:20.682641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:20.690183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:20.690618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:20.691523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:20.691935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:20.696868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:20.858360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:20.863910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7eb96ff-623d-4df8-9cc7-a2db7473c2be tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.186708 Jun 15 10:29:20.864500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 427/864] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:20 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:21.516307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:21.517998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:21.525493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:21.525937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:21.526744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:21.527181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:21.676494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:21.685216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fd3c6bc-b139-47d5-b4a4-efd8eef9eae0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.172737 Jun 15 10:29:21.685819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 438/865] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:21.883316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:21.887416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:21.893972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:21.894298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:21.894963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:21.895466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:22.052414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:22.060588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-05938a17-b379-4915-be98-23faf00858ed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.181474 Jun 15 10:29:22.061218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 428/866] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:21 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:22.704221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:22.705685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:22.713083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:22.713490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:22.714281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:22.714763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:22.871192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:22.879788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-82642f3e-4aa0-46a9-9cd8-9296de888458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179966 Jun 15 10:29:22.880409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 439/867] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:23.080351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:23.081411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:23.088620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:23.089249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:23.090152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:23.090643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:23.242107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:23.250475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a78fa533-2069-4a38-83b7-36d1090411b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.174879 Jun 15 10:29:23.251216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 429/868] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:23 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:23.899254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:23.899894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:23.907021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:23.908073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:23.908916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:23.909483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:24.089380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:24.098920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-521c4044-6009-4a1b-a812-7f6bdb6a0e3f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.203745 Jun 15 10:29:24.099506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 440/869] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:24.269029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:24.269718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:24.276939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:24.277411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:24.278190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:24.278632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:24.432199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:24.446260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cee272cb-23a0-448e-b752-4446e1f235f0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.181671 Jun 15 10:29:24.447308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 430/870] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:24 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:25.119140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:25.119935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:25.123400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=33 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:25.129825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:25.130330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:25.131170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:25.131652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:25.153242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:25.288739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:25.297445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48a37ff2-709e-408a-81aa-60640919b3ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.183965 Jun 15 10:29:25.298695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 441/871] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:25.466425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:25.467212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:25.469406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:25.476368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:25.476861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:25.477810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:25.478289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:25.659463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:25.668461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4e5d7d4-9166-46d4-b95b-dff65aa79bce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.206359 Jun 15 10:29:25.669277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 431/872] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:25 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:26.316636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:26.317295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:26.324394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.324851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.325689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.326133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.506108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:26.515388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b05f8248-f02f-46a0-8b3a-c60e5604b191 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.203082 Jun 15 10:29:26.521301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 442/873] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:26.692826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:26.694097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:26.707799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.708592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.710018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.710773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.867023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:26.875477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82afc8d1-5fa0-4d0f-990e-d868a3241f69 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.190857 Jun 15 10:29:26.876704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 432/874] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:26 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:27.540245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:27.541411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:27.549600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.550046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:27.550841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.551274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:27.763173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:27.777460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8097e8d4-aed2-47cf-bb87-6caa6cee467f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.241111 Jun 15 10:29:27.778409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 443/875] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:27.900151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:27.901388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:27.914555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.915362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:27.916836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.917693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:28.261934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:28.278120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec1ba6f8-a2e6-4abd-addd-dc68a5fe3c6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1683 microversion: 2.1 time: 0.386803 Jun 15 10:29:28.279544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 433/876] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:27 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:28.412168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:29:28.413295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:28.420215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:28.420670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:28.421488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:28.421918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:28.451734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'flavor' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:29:28.811583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:28.812814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:28.825288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:28.826288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:28.827682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:28.830226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:28.977397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b98ced2a-61fa-4e43-8627-d0ee5606caf4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action" status: 200 len: 32 microversion: 2.1 time: 0.569644 Jun 15 10:29:28.986515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 444/877] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:29:28 2022] POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action => generated 32 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 10:29:28.997460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:28.998805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:29.011088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:29.012205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:29.013691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:29.014477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:29.292728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:29.306996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53c0c51f-ea57-4bc5-b9a7-5e6de6b057b4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.318130 Jun 15 10:29:29.307884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 445/878] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:29.317669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:29.319253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:29.331094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:29.331780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:29.332720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:29.333460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:29.431716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:29.444114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e9bc22f-7b8d-4049-b484-5f7d08061abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1615 microversion: 2.1 time: 0.134182 Jun 15 10:29:29.445416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 446/879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:29 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:29.513003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:29.521810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-475324fe-6287-4208-b45a-a13d23449687 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.720546 Jun 15 10:29:29.522732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 434/880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:29.806053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-37e35988-6fe5-4e6d-beb7-363302d4f6e2 req-677a749b-3e39-413e-911e-6a98d7e0bfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2f5859-7f7e-4ff6-9489-cf042c8dfe93", "name": "network-vif-deleted", "tag": "96825d2b-5e77-418b-8449-7af5d7875a6c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:29:29.815697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37e35988-6fe5-4e6d-beb7-363302d4f6e2 req-677a749b-3e39-413e-911e-6a98d7e0bfa9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:29.816155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37e35988-6fe5-4e6d-beb7-363302d4f6e2 req-677a749b-3e39-413e-911e-6a98d7e0bfa9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:29.830319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-37e35988-6fe5-4e6d-beb7-363302d4f6e2 req-677a749b-3e39-413e-911e-6a98d7e0bfa9 service nova] Creating event network-vif-deleted:96825d2b-5e77-418b-8449-7af5d7875a6c for instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 on hv-cinder-84580 Jun 15 10:29:29.835739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-37e35988-6fe5-4e6d-beb7-363302d4f6e2 req-677a749b-3e39-413e-911e-6a98d7e0bfa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Jun 15 10:29:29.839530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 447/881] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:29:30.337749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:30.338505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:30.349525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.350243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:30.351595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.352356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:30.466499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:30.468061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:30.480588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.481597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:30.483171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.483874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:30.607696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:30.615727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:30.620033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d9836d6-4eca-4c78-a898-b20133038eca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.287408 Jun 15 10:29:30.624943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 435/882] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:30.637086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-982e7d74-c658-4e58-a55e-edbf73144744 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 200 len: 1326 microversion: 2.1 time: 0.174808 Jun 15 10:29:30.653058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 448/883] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:30 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 1326 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:30.819741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:30.820422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:30.828046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.828506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:30.830231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:30.830940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:31.049332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:31.059792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8e40375-5201-4525-8a53-517d83c2ce9d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.435082 Jun 15 10:29:31.060407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 436/884] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:31.645176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:31.646326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:31.654400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:31.654844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:31.656147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:31.656597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:31.668051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:31.677504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:31.694162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:31.694615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:31.695407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:31.695845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:31.717234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 HTTP/1.1 Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:29:31.719571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 10:29:31.723063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'cb2f5859-7f7e-4ff6-9489-cf042c8dfe93'} Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:29:31.724664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 10:29:31.727521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:29:31.730103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:29:31.730103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8825f112-210c-410f-876f-4746e105c4db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 404 len: 111 microversion: 2.1 time: 0.061757 Jun 15 10:29:31.730103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 437/885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:31 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:29:31.736271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2e64b118-edf3-4848-be61-236267731458 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '.version_select at 0x7fc27decf5e0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:31.837159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:31.848319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e75f6f20-73bf-44df-875b-a850ec6fbdd4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.207759 Jun 15 10:29:31.849268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 449/886] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:31 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:31.856453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2e64b118-edf3-4848-be61-236267731458 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744582897" status: 202 len: 0 microversion: 2.1 time: 0.127105 Jun 15 10:29:31.857825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 438/887] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Jun 15 10:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744582897 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:29:32.079946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:32.081104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:32.089028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.089968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.090950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.092198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.327274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:32.343194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-32149222-fb1f-429e-a4c8-ee6aa0ea74b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.268078 Jun 15 10:29:32.344256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 450/888] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:32.757497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:32.759249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:32.771804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.772769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.773827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.774408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.831421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab604c5b-25a2-433a-afa9-cbb1b1bb849c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments/61ea3ed6-c3cc-4fd4-a89d-de3fba779525" status: 200 len: 194 microversion: 2.20 time: 0.083050 Jun 15 10:29:32.832388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 439/889] 10.222.0.60 () {60 vars in 1453 bytes} [Wed Jun 15 10:29:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments/61ea3ed6-c3cc-4fd4-a89d-de3fba779525 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:32.871591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:32.872725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:32.886037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.887361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.888407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.889170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.929649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:32.930483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:32.943789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.944546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:32.946045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:32.946792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.072320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:33.083135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-902aca98-0009-4565-b3e3-c2dc071e9aef tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.218816 Jun 15 10:29:33.083833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 451/890] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:33.093723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:33.094621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:33.106219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.106747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.107909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.108439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.120049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lazy-loading 'services' on Instance uuid 68397bf4-b7e5-40fa-a541-3a52382f6fcc {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:29:33.268478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lazy-loading 'services' on Instance uuid c4944d55-b710-413e-81ed-24e682fa5479 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:29:33.463326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e61e7db5-048d-4ce5-8576-cd5c3a48036e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments/61ea3ed6-c3cc-4fd4-a89d-de3fba779525" status: 202 len: 0 microversion: 2.20 time: 0.541385 Jun 15 10:29:33.464449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 440/891] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Jun 15 10:29:32 2022] DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments/61ea3ed6-c3cc-4fd4-a89d-de3fba779525 => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:29:33.473335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:33.474229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:33.482580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.483114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.483952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.485214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.615059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10b0cbba-ccb8-4e70-a708-df1a4ab079d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments/7b0b662c-0601-4248-86f0-23c649f3a73b" status: 202 len: 0 microversion: 2.1 time: 0.529409 Jun 15 10:29:33.616194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 452/892] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:29:33 2022] DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments/7b0b662c-0601-4248-86f0-23c649f3a73b => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:29:33.622934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:33.624245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:33.632136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.632903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.633946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.634620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.662525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:33.675969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a43b21de-7502-4717-981e-e5e5a32da493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.209369 Jun 15 10:29:33.677272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 441/893] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:33.684076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5679144-771f-4f08-ad91-52bccfbfd344 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059393 Jun 15 10:29:33.684076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 453/894] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:33.685971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:33.688268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:33.700024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.700782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.701774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:33.702339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:33.742244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e68d937-59b3-4e0c-a5b5-d33abbf0ef6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063332 Jun 15 10:29:33.743059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 442/895] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:34.112231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:34.112819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:34.119752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.120200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.121054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.121491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.312453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:34.327257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1bdd8c0d-e761-4613-b726-5825920c0bb9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.219382 Jun 15 10:29:34.328223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 454/896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:34.693100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:34.694036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:34.701532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.702181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.703029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.703465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.709717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:34.710832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:34.722644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.723444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.724838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.725646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.737506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ff5b228-9746-42ea-8c2a-220cbcaa9f90 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049268 Jun 15 10:29:34.738092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 443/897] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:34.755573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:34.756595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:34.763216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.763935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.764719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:34.765192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:34.794850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:34.800793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86d87540-3a34-457e-9da0-919f616087f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049081 Jun 15 10:29:34.801417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 444/898] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:29:34.902247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:34.913225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c1e2292e-00f8-44fc-bd55-3b5f192c5b2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.213248 Jun 15 10:29:34.913978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 455/899] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:35.350614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:35.351591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:35.361011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.361860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.363336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.364138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.515820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:35.525324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d593aa3-d6d8-42d7-ab8f-d6b5ef103c1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.179669 Jun 15 10:29:35.525919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 445/900] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:35.750087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:35.751639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:35.759102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.759556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.760417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.760903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.765602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:35.796318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c2c21f7e-962c-4dbb-8448-163cafa30178 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050323 Jun 15 10:29:35.796909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 456/901] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:35.819959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:35.821682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:35.834235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.834863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.836190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.836930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.885599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2642b138-b3d3-4400-b860-322772f68d85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073221 Jun 15 10:29:35.886683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 446/902] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:35.935906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:35.937039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:35.950229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.950992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:35.952351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:35.953145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.110299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:36.119784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa0e694f-e978-44b2-8191-402b20d213fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.191202 Jun 15 10:29:36.120468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 457/903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:36.543955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:36.544725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:36.551563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.552015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.552806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.553273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.703121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:36.712721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-01696d76-c286-4a6a-9c5f-ba16a33d88ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.173165 Jun 15 10:29:36.713341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 447/904] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:36.808050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:36.809008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:36.816032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.816482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.817305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.817745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.852285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ac837185-a585-4210-a707-aeb11528724b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048190 Jun 15 10:29:36.852929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 458/905] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:36.900172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:36.901336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:36.908952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.909434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.910214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:36.910650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:36.945086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c67ddd5-1d20-4af3-b69b-53acf1e5231d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Jun 15 10:29:36.945674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 448/906] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:37.137691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:37.138302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:37.145706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.146149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.146928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.147358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.298510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:37.307134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-91ba5974-ec36-47c1-a0e5-66d22eb9ce1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173393 Jun 15 10:29:37.307738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 459/907] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:37.732244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:37.732859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:37.740361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.740727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.741545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.741981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.867541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:37.869348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:37.880766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.881586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.882963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.883702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.915178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:37.925293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c83053c-94f8-4a43-8296-46c1174e0fc5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.197066 Jun 15 10:29:37.926152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 449/908] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:37.933851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2676860f-429c-4988-90fd-7bca86a29528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072941 Jun 15 10:29:37.934442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 460/909] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:37.961432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:37.963015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:37.973862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.974635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:37.975996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:37.976763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.015356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4cc798e7-4ba8-43a1-b664-b1a03dd7b259 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061399 Jun 15 10:29:38.015963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 450/910] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:38.325037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:38.325627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:38.334038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.334533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.335362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.335833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.490040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:38.498672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3657c62-1bf7-42e8-83a5-802e59aeb1a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177679 Jun 15 10:29:38.499363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 461/911] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:38.946813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:38.947765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:38.959533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:38.960243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.960243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.960450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:38.960536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.960536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.975162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.976020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.977082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:38.977701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:38.994398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c2c3525-b501-4d44-a626-3d30c2ac4b08 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051711 Jun 15 10:29:38.994986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 451/912] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:39.028648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:39.029725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:39.041228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:39.042202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:39.044056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:39.044841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:39.101811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2402f473-d809-4052-84c5-8fe023588570 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077247 Jun 15 10:29:39.102855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 452/913] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:29:39.160011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:39.169046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dfcd5fee-9748-4e3a-9c86-e0763a758cd5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.222254 Jun 15 10:29:39.169641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 462/914] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:39.517233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:39.517939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:39.525323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:39.525862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:39.526834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:39.527353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:39.700269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:39.714272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ddc72dc-4b45-4750-bd13-613d627cb879 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.201090 Jun 15 10:29:39.715139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 453/915] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:40.006860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:40.007800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:40.014999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.015447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.016241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.017221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.064083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9c2e608e-b5d4-495c-be93-735b4e23218c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060886 Jun 15 10:29:40.065118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 463/916] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:40.115886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:40.116842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:40.124067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.124509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.125354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.125801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.161406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aca09c12-41f1-4e06-bdfd-513c7d8fdc2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049989 Jun 15 10:29:40.162202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 454/917] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:40.196257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:40.197307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:40.206743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.207258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.208208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.208709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.365106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:40.374517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-877d65fc-d062-4583-b2b4-7410e475928b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.182267 Jun 15 10:29:40.375127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 464/918] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:40.739153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:40.740325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:40.752231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.753099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.754606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:40.764741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:40.943762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:40.952219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-169d56b0-16be-4907-aa25-a06979b48932 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.220533 Jun 15 10:29:40.952815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 455/919] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:41.079072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:41.081384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:41.088775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.089301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.090189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.090661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.136655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-61fc014c-629b-4233-adee-bd174b533c99 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061465 Jun 15 10:29:41.137675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 465/920] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:41.174396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:41.175380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:41.182363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.182806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.183589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.184018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.242690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b16124b9-22bd-4cb7-b06c-f434fb540735 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072564 Jun 15 10:29:41.243783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 456/921] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:41.396385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:41.396924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:41.403804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.404257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.405158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.405628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.599480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:41.606879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1273ca92-021b-4d30-bf9f-f851bcdce3fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.216360 Jun 15 10:29:41.620879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 466/922] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:41.976048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:41.977115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:41.988258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.989079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:41.990473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:41.991229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.151232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:42.152562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:42.168191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.168908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.171152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.171152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.219789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-184282d6-74d4-42ad-84d7-7741af9717b4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073355 Jun 15 10:29:42.222280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 467/923] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:42.240100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:42.250430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f35cb8a2-0685-49c3-92b4-259e73abd261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.282087 Jun 15 10:29:42.251151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 457/924] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:42.261191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:42.262950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:42.275418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.276187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.277604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.278388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.316879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b675c89-43dd-44da-bd5c-f637f94f59fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063056 Jun 15 10:29:42.317576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 468/925] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:42.643145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:42.643819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:42.650693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.651297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.652123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:42.652565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:42.802265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:42.811131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c70ed7a7-5836-4954-a6f3-e546e605c666 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.172899 Jun 15 10:29:42.811848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 458/926] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:43.236343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:43.237674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:43.248020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.248521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.249427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.249993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.269751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:43.270526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:43.279358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.279823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.280657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.281132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.301905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d4e7fd7-a569-4210-b9a3-cee9798e4419 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071353 Jun 15 10:29:43.302506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 469/927] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:43.329434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:43.330524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:43.337414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.337954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.338860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.339323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.375025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4e30f845-1b34-466e-b10a-d64380154433 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049781 Jun 15 10:29:43.376409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 470/928] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:29:43.444449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:43.453383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1508d527-1677-43a6-ac95-41d77dbf89a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188266 Jun 15 10:29:43.455286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 459/929] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:43.832509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:43.833336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:43.845830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.846690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:43.848121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:43.848886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.036583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:44.045839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-59f80ed8-8fc4-4983-bc14-b1125126046a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.219866 Jun 15 10:29:44.046560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 471/930] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:44.317203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:44.318490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:44.326337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.326853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.327658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.328095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.369638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b01c4ff4-ea25-4373-aeb5-39e487310ac4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056810 Jun 15 10:29:44.370143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 460/931] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:44.394348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:44.395438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:44.402247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.402696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.403516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.403957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.432528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:44.437965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc3c5a09-5b5f-4b37-be5d-455a03fe0c57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048244 Jun 15 10:29:44.439135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 472/932] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:44.473562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:44.474200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:44.480860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.481451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.482262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:44.482737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:44.504616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:44.649801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:44.663094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfea2b31-ee72-453b-b1bf-25f9ab8fcbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193323 Jun 15 10:29:44.664013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 461/933] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:45.065675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:45.066340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:45.073769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.074245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.075042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.075483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.232562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:45.242337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a29fc9e0-7df1-476d-90bf-b3d9907e6d96 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.182300 Jun 15 10:29:45.242933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 473/934] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:45.383050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:45.384020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:45.391515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.392005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.392872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.393351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.428360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4e57561-b103-44c8-8a49-60e1f24373ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049351 Jun 15 10:29:45.428949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 462/935] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:45.455242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:45.456514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:45.463724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.464210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.465256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.465772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.499985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a974b504-1726-4a3f-80b4-f8bfeca8b054 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049323 Jun 15 10:29:45.500748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 474/936] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:45.682103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:45.682611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:45.689090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.689638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.690498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:45.690937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:45.845734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:45.854550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fac191e-2b71-47f5-8538-a4c3ea1b6a1d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176453 Jun 15 10:29:45.855152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 463/937] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:46.261208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:46.261909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:46.269596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.270035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.270820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.271258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.441038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:46.442316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:46.445637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:46.450833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.451400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.452385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.452922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.456379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c26ee74-e2ae-48c2-9e5b-86a6230909f8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.199267 Jun 15 10:29:46.461319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 475/938] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:46.492754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9653ae3-7619-4841-b4f5-78718086e02d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055847 Jun 15 10:29:46.493758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 464/939] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:46.518227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:46.519955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:46.531393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.532701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.534193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.535003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.573392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f91bd1a-b079-4f8a-a856-68852e864597 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063729 Jun 15 10:29:46.574011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 476/940] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:46.872664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:46.873217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:46.880592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.881083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:46.881883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:46.882325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.043873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:47.052590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a849f81-07a0-41c0-839b-e101e0f6de1f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.184024 Jun 15 10:29:47.053226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 465/941] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:47.476133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:47.476863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:47.484164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.484772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.486318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.486809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.509875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:47.511439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:47.519628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.520224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.521182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.521762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.560398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98655f40-9040-4495-b9f8-7ed09871bb73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057254 Jun 15 10:29:47.561356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 466/942] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:47.588853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:47.589901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:47.596826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.597299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.598089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.599114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.639746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff6b4d73-62d3-4e52-b446-567dd7794d6e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055361 Jun 15 10:29:47.645956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 467/943] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:29:47.679513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:47.690733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8213d27c-718a-4851-9f97-8ae33fa353c1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.218175 Jun 15 10:29:47.693251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 477/944] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:47.772347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-66427028-02cf-4ac8-93dd-6fb16af92f6d req-f7dd2dca-f8de-4718-ae84-22d3f5d1ac06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "name": "network-vif-unplugged", "status": "completed", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:29:47.781809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-66427028-02cf-4ac8-93dd-6fb16af92f6d req-f7dd2dca-f8de-4718-ae84-22d3f5d1ac06 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:47.782445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-66427028-02cf-4ac8-93dd-6fb16af92f6d req-f7dd2dca-f8de-4718-ae84-22d3f5d1ac06 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:47.795890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-66427028-02cf-4ac8-93dd-6fb16af92f6d req-f7dd2dca-f8de-4718-ae84-22d3f5d1ac06 service nova] Creating event network-vif-unplugged:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:29:47.802228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-66427028-02cf-4ac8-93dd-6fb16af92f6d req-f7dd2dca-f8de-4718-ae84-22d3f5d1ac06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035309 Jun 15 10:29:47.802925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 468/945] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:48.077031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:48.077595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:48.085459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.085907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.086702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.087141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.250711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:48.259368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2842c7a4-5175-4e65-b7e8-ae12f4a3a212 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186346 Jun 15 10:29:48.259960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 478/946] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:48.580517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:48.582681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:48.591057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.591922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.593001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.593683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.639909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc9e72da-d38c-4599-94bf-0a5db08ed42b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067742 Jun 15 10:29:48.641383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 469/947] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:48.654580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:48.656095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:48.665230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.665686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.666530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.667531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.702658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cafce524-7b32-4483-b2a8-1bbcea5c80da tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052446 Jun 15 10:29:48.703356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 479/948] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:48.712943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:48.714018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:48.721327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.721776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.722567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:48.723003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:48.878708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:48.887383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4ecc332c-f434-44cd-8291-33526ab44256 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.179485 Jun 15 10:29:48.887981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 470/949] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:49.278095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:49.278095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:49.285060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.285500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.286346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.286782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.434659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:49.444046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a10bc413-d53f-423a-bb8c-d4b750308f7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170464 Jun 15 10:29:49.444342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 480/950] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:49.653576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:49.654487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:49.661464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.661911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.663961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.664416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.699164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a41cfdb-55ab-4863-ab90-343c5d55a425 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049484 Jun 15 10:29:49.699758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 471/951] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:49.718661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:49.733043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:49.733043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.733043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.733043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.733432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.768073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa0ee387-684a-4d28-b410-70a4f454936a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056046 Jun 15 10:29:49.769163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 481/952] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:49.906901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:49.908146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:49.914698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.915143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:49.915949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:49.916391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.069645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:50.085134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db9b7980-9dd2-4980-a456-68b990ca4661 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.181760 Jun 15 10:29:50.086111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 472/953] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:50.462088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:50.462719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:50.469876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.470334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.471187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.471638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.650612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:50.659679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0aab5a48-4470-4d29-9976-b18315b7a0e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.201633 Jun 15 10:29:50.660272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 482/954] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:50.712651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:50.713535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:50.721409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.721921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.722772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.723211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.759060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2f4f099-5b56-4c43-8a8f-606337baee29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050744 Jun 15 10:29:50.759658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 473/955] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:29:50.780430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:50.781412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:50.792760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.793507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.794370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:50.794845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:50.835340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fdb126c8-b7c5-404d-aa78-cbe7dc1c15c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058838 Jun 15 10:29:50.836079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 483/956] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:51.115322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:51.116417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:51.125199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.125784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.126649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.127166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.341069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:51.351709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10736d26-9164-42f8-aa60-2a47daedbfd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1713 microversion: 2.1 time: 0.244415 Jun 15 10:29:51.352555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 474/957] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1713 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:51.425415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:51.434047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:51.434047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.434047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.434047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.434588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.680475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:51.681427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:51.690509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.691088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.691956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.692591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.850651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:51.863101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4973baa1-886c-487d-ac73-143825cfbdbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188544 Jun 15 10:29:51.863694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 475/958] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:51.868775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:51.869956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:51.877316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.877775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.878551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.878981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.912334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a36b37e-5d31-4d3c-8ac6-3a8e3965886d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047538 Jun 15 10:29:51.912922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 476/959] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:51.918113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:51.925865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:51.926598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.927412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.928774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:51.929591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:51.964795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4ce17ea-f32e-4fd7-b827-548e1b211fdf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050764 Jun 15 10:29:51.965414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 477/960] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:52.882989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:52.883681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:52.890958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:52.891994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:52.892790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:52.893489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:53.099841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:53.103987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:53.109091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c738b4b9-a98e-479c-8f41-ef737b53ac66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.230188 Jun 15 10:29:53.117362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 478/961] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:53.117362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:53.117362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:53.123130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:53.123756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:53.124551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:53.125011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:53.161367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-91e4d5c2-5f46-4f93-a60c-b3537a1c9fc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050304 Jun 15 10:29:53.162102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 479/962] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:53.167562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:53.168494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:53.170502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:53.176312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:53.176850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:53.177681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:53.180066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:53.213511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a592384-23f8-46c7-b3c2-babad6982d35 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050077 Jun 15 10:29:53.214104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 480/963] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:54.129313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:54.130113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:54.138457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.138896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.139666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.140180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.291848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:54.301187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0613457a-4d27-44ff-9204-cf03cc869b00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177008 Jun 15 10:29:54.304877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 481/964] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:54.306816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:54.307784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:54.315609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.316054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.316833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.317303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.351955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35944bea-3f54-4992-968a-8a0dcb553a0d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048980 Jun 15 10:29:54.352547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 482/965] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:54.357568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:54.358550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:54.365665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.366200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.367182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:54.367663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:54.401237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9cec384d-f893-4b00-9244-911e7ba9fa13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Jun 15 10:29:54.401706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 483/966] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:55.324196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:55.325206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:55.335478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.336184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.337053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.337634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.506936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:55.515061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c871f3f6-af37-4892-8271-d07d6f3e9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.197772 Jun 15 10:29:55.515640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 484/967] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:55.521087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:55.522017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:55.529119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.529580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.530459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.530898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.566972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a256facd-3c57-499a-80d6-e3c2cef73e12 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050238 Jun 15 10:29:55.567559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 485/968] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:55.572381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:55.573348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:55.580470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.580825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.581892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:55.582330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:55.615321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d56de0c-ab04-49f3-b484-2c6811a56d8f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Jun 15 10:29:55.615927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 486/969] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:56.546093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:56.547246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:56.559732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.560529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.562018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.562815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.741241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:56.749736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-956f5845-5630-4e11-83a1-e777a6e04719 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.210978 Jun 15 10:29:56.750330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 487/970] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:56.756138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:56.757148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:56.764174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.764626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.765576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.766040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.802468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7164bd72-b5cf-4df4-a266-d4ac69b5b99c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050965 Jun 15 10:29:56.803076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 488/971] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:56.807928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:56.808889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:56.815821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.816263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.817175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:56.817613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:56.854974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82b30ee7-d5e8-47b3-8cc4-bc459576d4a2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050800 Jun 15 10:29:56.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 489/972] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:57.773079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:57.773830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:57.787791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:57.788244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:57.789055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:57.789491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:57.982759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:57.997498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3c1de35-4491-49af-959d-480f3ebc65e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.228777 Jun 15 10:29:57.998961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 490/973] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:58.008775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:58.010494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:58.020705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:58.021253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:58.022086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:58.022557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:58.057799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57f05101-3461-4832-95be-c2db414463ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058260 Jun 15 10:29:58.058490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 491/974] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:58.063457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:58.071636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:58.078665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:58.079590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:58.080619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:58.081863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:58.131584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a151615f-93d0-4cc2-9bf4-d55732b675d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071502 Jun 15 10:29:58.132566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 492/975] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:59.023854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:59.024579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:59.031501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.032502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.033354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.033793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.381186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:29:59.396132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94244951-99c7-4880-b25d-7d32570f1afc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.375817 Jun 15 10:29:59.397225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 493/976] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:29:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:29:59.406002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:59.407736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:59.416515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.416995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.417809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.418249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.456774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97a85018-0e5d-4a57-acff-63e5fa7561ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057528 Jun 15 10:29:59.457551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 494/977] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:29:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:59.462630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:59.463575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:29:59.470275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.470729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.471508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:59.471942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:59.491047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:59.507171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8925ad06-0417-40b3-b1c4-fa49aacf8411 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Jun 15 10:29:59.509201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 495/978] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:29:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:00.418311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:00.419065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:00.427088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.427534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.428316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.428838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.586562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:00.595736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86ad26ff-40c3-46ae-a013-b1f2a22f7696 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.181398 Jun 15 10:30:00.596318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 496/979] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:00.601364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:00.602305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:00.608841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.609325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.610204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.611140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.648558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b969f545-f4a0-46c3-9d3e-2570d5423876 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051109 Jun 15 10:30:00.650266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 497/980] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:00.655050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:00.656204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:00.663485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.663938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.664739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:00.665278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:00.700255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9d130fc-d6e0-4e0f-b713-d4fa7ae125f1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049727 Jun 15 10:30:00.700723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 498/981] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:01.430831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=87 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:01.456918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=70 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:01.618066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:01.618664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:01.626610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.627194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.627989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.628421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.788273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:01.796823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b07d85ba-451b-4f47-8125-17144277ac00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.182477 Jun 15 10:30:01.797436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 499/982] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:01.802540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:01.803461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:01.810343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.810781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.811600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.812034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.848652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8fb43e06-896e-47bd-bf37-01a40a07f259 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049955 Jun 15 10:30:01.849352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 500/983] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:01.854399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:01.855322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:01.863007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.863525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.864427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:01.864905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:01.903049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77099248-037a-4718-a35c-67bec4128b3e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052589 Jun 15 10:30:01.903817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 501/984] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:02.817708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:02.818415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:02.825294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:02.825738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:02.826512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:02.826942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:02.973584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:02.981757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c324437-f538-44a8-8652-be753225e4b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.169271 Jun 15 10:30:02.982340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 502/985] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:02.987683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:02.988752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:02.995250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:02.995699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:02.996481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:02.996923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:03.030454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75051727-b351-44e4-b48a-5e8a8bd2b592 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046828 Jun 15 10:30:03.031040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 503/986] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:03.036731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:03.037676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:03.044314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:03.044761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:03.045606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:03.046054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:03.078588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6cbc9dd7-77fa-466f-a19f-b98dadeb903c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Jun 15 10:30:03.079317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 504/987] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:04.000772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:04.002137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:04.009563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.010013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.010793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.011230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.163017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:04.171263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c4a3068-17ec-4c3b-b7f0-1efe4e285ac6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175055 Jun 15 10:30:04.171834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 505/988] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:04.178068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:04.179007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:04.185942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.186385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.187172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.187586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.220034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8545af54-afea-49a9-8a3b-f727bac60816 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046817 Jun 15 10:30:04.220847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 506/989] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:04.225852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:04.226782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:04.233310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.233756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.234531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:04.235474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:04.268324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fec144d-0e0c-4a22-bf63-f7baae98f1a6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Jun 15 10:30:04.268815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 507/990] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:05.189513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:05.190272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:05.197635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.198081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.198873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.199305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.356924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:05.366237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59d4bfc6-f240-4465-96a3-1e24469a31ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.180907 Jun 15 10:30:05.366795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 508/991] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:05.371770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:05.372690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:05.380673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.381153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.381939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.382377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.413542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bff135fc-52dc-4cb4-971c-70e2548fbe20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045622 Jun 15 10:30:05.414136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 509/992] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:05.419413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:05.420333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:05.427922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.428368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.429191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:05.429663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:05.463144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-760125db-c4b1-489d-8d48-08644b3df072 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Jun 15 10:30:05.463721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 510/993] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:06.386153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:06.386843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:06.394599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.395048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.395832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.396264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.553820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:06.562508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32b7dc38-8671-4927-a848-628c68032525 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.180115 Jun 15 10:30:06.563646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 511/994] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:06.569029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:06.569971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:06.577265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.577716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.578510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.579605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.584439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:06.615380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3e1efca0-7153-4174-b3c5-36f24be29adf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050389 Jun 15 10:30:06.615965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 512/995] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:06.621123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:06.622283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:06.630617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.631096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.631894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:06.632392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:06.670251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d96687b7-7df0-4cf4-b8d9-d1c5de080843 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053160 Jun 15 10:30:06.670845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 513/996] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:07.582461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:07.583390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:07.590560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.591011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.591827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.592269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.748668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:07.757444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b654d1a-abdd-41cd-b5eb-58b2dd984302 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179080 Jun 15 10:30:07.758296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 514/997] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:07.768463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:07.770201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:07.779824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.780324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.781226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.781711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.816383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5964dbea-00c1-443a-b238-b18d0061c6a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056505 Jun 15 10:30:07.816882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 515/998] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:07.821940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:07.822888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:07.830413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.830855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.831898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:07.832358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:07.866498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5041fe7e-68e2-4c9a-bbcc-ff233883849e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048371 Jun 15 10:30:07.867258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 516/999] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:08.785148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:08.786165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:08.794161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.794813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.795841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:08.796393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:08.972332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:08.981323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-308034ce-f31f-4fd4-8e10-9374d6ad8871 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200642 Jun 15 10:30:08.981977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 517/1000] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:08.989505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:08.991079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:09.004753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.005545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.006946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.007732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.042928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ede1c194-7883-4d94-ae36-7d56182a13b0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059530 Jun 15 10:30:09.043508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 518/1001] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:09.048528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:09.049495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:09.056437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.056865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.057691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:09.058122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:09.094758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d01eaebd-4b13-4cca-9c88-87ac6864bb96 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049984 Jun 15 10:30:09.095413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 519/1002] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:09.611664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:30:09.617454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:30:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:30:10.008245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:10.008839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:10.016752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.017257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.018046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.018476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.198904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:10.213620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-326aa1e6-5392-46a6-ad5a-f51d9a9c6253 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.208967 Jun 15 10:30:10.214563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 520/1003] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:10.223744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:10.225360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:10.233444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.234166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.235151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.235601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.271178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e98d23f-6fe1-4a0c-99e4-f86c417e577f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055097 Jun 15 10:30:10.271663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 521/1004] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:10.276664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:10.277610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:10.284526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.284995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.285767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:10.286200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:10.318440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64aec737-a337-4cf7-a08f-11944f763f97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Jun 15 10:30:10.319013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 522/1005] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:11.232464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:11.233211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:11.241268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.241711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.242522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.242956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.397890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:11.405995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a2a460c-f45c-4fbf-a943-92e0f2d12b87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177980 Jun 15 10:30:11.406571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 523/1006] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:11.412189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:11.413139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:11.419931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.420373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.421194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.421628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.458183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dba8c9f7-d8c9-4ef6-9ee1-4b04d9b275d2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049756 Jun 15 10:30:11.458776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 524/1007] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:11.463743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:11.464783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:11.473592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.474040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.474844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:11.475282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:11.515052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-79efcf23-2de5-4e91-acbe-d8051829fece tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055052 Jun 15 10:30:11.515554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 525/1008] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:12.424227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:12.425052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:12.432141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.432576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.433386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.433815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.613003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:12.622301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a77579c-22e0-4e4f-9862-a7583b23b055 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.202033 Jun 15 10:30:12.623034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 526/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:12.629906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:12.631034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:12.637794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.638378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.639277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.639854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.678149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e727de11-49e9-4e49-9a17-1aefd50f4ee0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053857 Jun 15 10:30:12.678787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 527/1010] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:12.683993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:12.685001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:12.695838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.696541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.697832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:12.698448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:12.728931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:12.734201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5e07dd3b-254e-4c2a-a0cc-8c12ed26558e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054220 Jun 15 10:30:12.734782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 528/1011] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:13.642971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:13.643704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:13.651295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.651779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.652630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.653168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.814721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:13.823438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d2a628f-96c5-4cb1-b9da-b66893803e87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186430 Jun 15 10:30:13.824266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 529/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:13.829516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:13.830469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:13.835098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:13.838314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.838769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.839568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.840008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.879686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-175ff593-2c4a-48f1-8fb2-cc2ee163311c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054500 Jun 15 10:30:13.880431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 530/1013] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:13.887048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:13.888305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:13.898125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.898719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.899575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:13.900119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:13.954595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b146d67-a446-497c-9c95-4a031fcea04e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072098 Jun 15 10:30:13.955552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 531/1014] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:14.854771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:14.855780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:14.868622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:14.869363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:14.870703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:14.871453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.040352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:15.049860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f35b8a1-469c-4a6a-8f34-6316b2e187c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.202774 Jun 15 10:30:15.050451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 532/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:15.055308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.056232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.062870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.063446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.064354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.064788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.099148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-469cc983-1920-409d-b987-8fa7a46cc959 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047594 Jun 15 10:30:15.099836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 533/1016] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:15.104764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:15.105788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:15.113497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.113922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.114696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:15.115123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:15.149334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-015d4f8b-dc01-4e90-b7dd-ab2cb293f896 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 Jun 15 10:30:15.150076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 534/1017] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:16.069468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:16.070491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:16.078094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.079237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.081008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.081825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.255935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:16.264493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce38ee2a-d01a-4295-b604-b87c5c7f1862 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.199300 Jun 15 10:30:16.265136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 535/1018] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:16.271252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:16.272399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:16.280091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.280626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.281476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.282435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.317571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-236577a6-701f-4b8c-a955-b670f1eda034 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051273 Jun 15 10:30:16.318163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 536/1019] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:16.323519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:16.324369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:16.333283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.341723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.341723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:16.341723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:16.371551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27710966-427e-4409-b82c-6612a91a7a7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052189 Jun 15 10:30:16.377178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 537/1020] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:17.284224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:17.284904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:17.292306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.292760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.293572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.294002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.441181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:17.449607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4983f773-987f-4b9a-ad35-ad8425464b27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170073 Jun 15 10:30:17.450193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 538/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:17.455579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:17.456484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:17.463745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.464189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.465115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.465449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.498949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4eac5e4-8238-4c54-8139-f0fe460fa2a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047652 Jun 15 10:30:17.499530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 539/1022] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:17.505077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:17.506013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:17.512332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.512783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.513599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:17.514124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:17.546805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40f54966-ae06-4881-914f-3d422275fa33 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Jun 15 10:30:17.547925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 540/1023] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:18.210133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:18.210671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:18.217475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.217919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.218701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.219132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.253000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:30:18.623653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cba9ead9-663b-48dd-ac53-6c6a85785d32 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 204 len: 0 microversion: 2.1 time: 0.417532 Jun 15 10:30:18.624475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 541/1024] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:30:18 2022] DELETE /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:30:18.631127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:18.636857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:18.639258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.639704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.640485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.640917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.814770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:18.826806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f368e002-c65a-4b2f-9cbd-9af756baba63 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200760 Jun 15 10:30:18.827456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 542/1025] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:18.836925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:18.838601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:18.849675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.850455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.851658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.852299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.904729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:18.915574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6aa73b9-2ca7-43ca-8e91-4f7cb3b1c2fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086359 Jun 15 10:30:18.920617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 543/1026] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:18.926447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:18.928090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:18.941738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.942536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.944039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:18.944851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:18.990325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27a962eb-11b5-425f-be55-9aa42f31ff39 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072148 Jun 15 10:30:18.990916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 544/1027] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:18.995823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:18.996460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:19.007780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:19.008529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:19.009891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:19.010602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:19.210383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:19.226827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b2e5543-d6ca-46a9-bc20-3f792f0e9f5a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1576 microversion: 2.1 time: 0.234432 Jun 15 10:30:19.227908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 545/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:18 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:19.847420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:19.848919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:19.860739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:19.861550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:19.862837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:19.863564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.066981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:20.080175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00cba96b-de66-459d-8b94-b6b59152806b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.236454 Jun 15 10:30:20.080996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 546/1029] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:20.090253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:20.092058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:20.106748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.107312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.108630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.109362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.161059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e449275e-6f9b-4016-8617-c4829ec851f4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078020 Jun 15 10:30:20.162150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 547/1030] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:20.170523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:20.172024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:20.182518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.183236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.184477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.185226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.236599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a2189b58-b9ac-4025-84d4-8e322e8b8d87 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072708 Jun 15 10:30:20.237724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 548/1031] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:20.259714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:20.260826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:20.271813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.272602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.274074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:20.274873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:20.478440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:20.491646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e004541f-4fee-404f-927f-fe17d723f42a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1576 microversion: 2.1 time: 0.239028 Jun 15 10:30:20.492458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 549/1032] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:20 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:21.112397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:21.113506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:21.126703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.127579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.129034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.129842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.393131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:21.409518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5dc749e2-0d37-4473-9aa5-4eb7d04f78b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.305119 Jun 15 10:30:21.410580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 550/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:21.420263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:21.422285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:21.433704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.434495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.435896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.436663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.499571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-689e9f45-f0a3-43e8-8e1b-27f06b4f3601 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086895 Jun 15 10:30:21.501367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 551/1034] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:21.511029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:21.513019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:21.525724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.526533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.528000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.528760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.586317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64d3949e-e741-4cd3-8d8a-bc2890df195f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082842 Jun 15 10:30:21.597699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 552/1035] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:21.598955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:21.600108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:21.612928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.613787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.615152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:21.615934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:21.953039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:21.967885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f6b8792-6cc2-4c16-8cab-e4d682d0b522 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1508 microversion: 2.1 time: 0.377365 Jun 15 10:30:21.970150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 553/1036] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:21 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:22.194332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-14f75245-6790-4f79-b998-d6503c374e1a req-dd940acd-f7c3-49d0-a828-df806fdc6339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd0d535-7284-4990-a7aa-9cb616268d39", "name": "network-vif-deleted", "tag": "9efed795-e65a-463e-9459-226eeae54890"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:30:22.206432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-14f75245-6790-4f79-b998-d6503c374e1a req-dd940acd-f7c3-49d0-a828-df806fdc6339 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.207223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-14f75245-6790-4f79-b998-d6503c374e1a req-dd940acd-f7c3-49d0-a828-df806fdc6339 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.221100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-14f75245-6790-4f79-b998-d6503c374e1a req-dd940acd-f7c3-49d0-a828-df806fdc6339 service nova] Creating event network-vif-deleted:9efed795-e65a-463e-9459-226eeae54890 for instance 1bd0d535-7284-4990-a7aa-9cb616268d39 on hv-cinder-84580 Jun 15 10:30:22.226772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-14f75245-6790-4f79-b998-d6503c374e1a req-dd940acd-f7c3-49d0-a828-df806fdc6339 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036061 Jun 15 10:30:22.229367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 554/1037] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:22.430560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:22.431180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:22.439359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.439872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.440709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.441186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.614226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:22.622774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-73dedba7-de60-403d-98e2-4ba79f8524ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.196712 Jun 15 10:30:22.623356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 555/1038] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:22.629499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:22.630790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:22.638364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.638563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.639346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.639784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.691516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b799e49b-a157-4b8a-8e60-949a9fbf6ab2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066569 Jun 15 10:30:22.692516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 556/1039] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:22.701745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:22.703429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:22.715688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.716493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.718013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:22.718794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:22.756157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ef453cc-a748-45b5-abfb-1c4efc96c9de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061974 Jun 15 10:30:22.756756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 557/1040] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:22.989515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:22.991000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:23.002962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.003771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.005326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.006107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.096047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:23.104498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eecb4b07-4de1-47f7-877f-6a9b601bfa7a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.121502 Jun 15 10:30:23.105128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 558/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:22 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:23.640569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:23.641407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:23.648843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.649467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.650243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.650675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.827677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:23.844123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba829a6d-896d-4c2f-be9b-c5d0dc72b673 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.207174 Jun 15 10:30:23.845373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 559/1042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:23.854783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:23.856501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:23.868260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.869092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.870487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.871250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.909368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbc92f7b-c346-49ce-9450-44cc3fc4a6ff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062503 Jun 15 10:30:23.909955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 560/1043] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:23.915804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:23.916739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:23.923770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.924221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.925012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:23.925450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:23.929787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:23.960149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-311a00d8-aeee-4f07-b0c5-7c4b3a2f34c4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049075 Jun 15 10:30:23.961151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 561/1044] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:24.127320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:24.128268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:24.139909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:24.159246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:24.159246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:24.159246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:24.240393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:24.250207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-658cee55-7bc3-4c28-9890-1ff210cf4c08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.130641 Jun 15 10:30:24.251803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 562/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:24 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:24.866968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:24.867948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:24.874748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:24.878311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:24.878311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:24.878311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.038955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:25.048152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10926ce6-484b-4ee6-a786-dfc31657eba5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.187241 Jun 15 10:30:25.048796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 563/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:25.054141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:25.055088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:25.062089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.062542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.063922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.064531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.099508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc7a39b0-b9e6-449c-851d-90fe766e2acd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049507 Jun 15 10:30:25.100110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 564/1047] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:25.106526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:25.107475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:25.114667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.115116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.115901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.116343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.150789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19b31da9-c15e-49df-848b-fd666eb51cb4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049392 Jun 15 10:30:25.151294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 565/1048] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:25.272136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:25.272756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:25.279522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.279973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.280805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:25.281274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:25.352661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:25.361912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-752930d4-752d-427b-b9a3-9b984411e3c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093754 Jun 15 10:30:25.362502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 566/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:25 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:26.068633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:26.069389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:26.076375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.076803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.077635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.078103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.276283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:26.285804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a91cfc1-260c-43b0-a714-4584014241c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.221187 Jun 15 10:30:26.286483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 567/1050] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:26.295916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:26.298359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:26.307551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.308007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.308815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.309298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.345656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b34c3562-683f-4a81-ab3e-3b862245f1bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057524 Jun 15 10:30:26.346217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 568/1051] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:26.351390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:26.352373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:26.359153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.359632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.361153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.361599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.397968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-166e254c-01e7-4487-8fc7-d50bb228d577 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050598 Jun 15 10:30:26.398596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 569/1052] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:26.403507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:26.404135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:26.410981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.411429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.412258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:26.412697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:26.482772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:26.492093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-214bddb4-2c7a-4d8a-8606-2ac8a1b9ed11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092406 Jun 15 10:30:26.492678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 570/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:26 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:27.311954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:27.312688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:27.319951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.320412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.321248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.321691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.479789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:27.495019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ce3d617-bc6e-482b-8b32-7cbd51afe058 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186600 Jun 15 10:30:27.496083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 571/1054] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:27.505581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:27.507441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:27.519371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.520162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.521556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.522322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.559223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fe96aec-76fc-49d5-b332-16b27ef287ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061552 Jun 15 10:30:27.559839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 572/1055] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:27.565767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:27.566628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:27.573098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.573577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.574365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.574814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.610509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e8df6cc-a44f-4d61-b931-10dd812ed934 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049583 Jun 15 10:30:27.611198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 573/1056] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:27.616394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:27.617105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:27.623658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.624108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.624892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:27.625943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:27.700418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:27.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf0bff3b-a32c-4f5b-98c1-eb2e39d526d8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.101680 Jun 15 10:30:27.715445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 574/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:27 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:28.514309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:28.515151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:28.523635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.524071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.524885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.525338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.685678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:28.695450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d5af375-334c-4d55-ace2-de44ad3947d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185246 Jun 15 10:30:28.696064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 575/1058] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:28.701364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:28.702296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:28.710237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.710740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.711743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.712448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.750130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb1295ee-3164-4d3d-a374-54d13179b9dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052946 Jun 15 10:30:28.751033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 576/1059] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:28.756292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:28.757324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:28.759331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:28.765143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.765513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.766930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.767452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.796663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:28.801527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e73d0367-7b6d-42cd-91a9-781d9d835343 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049272 Jun 15 10:30:28.802122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 577/1060] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:28.807385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:28.808004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:28.814967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.815414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.816205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:28.816644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:28.889161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:28.903725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-432d5a8d-1b10-47b4-829b-046926cd813a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100152 Jun 15 10:30:28.904783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 578/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:28 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:29.714482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:29.715208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:29.725114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.725587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:29.726361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.726975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:29.901552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:29.911045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a12f6ac-df4f-451e-a4a5-a6041a6bc995 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200460 Jun 15 10:30:29.911746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 579/1062] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:29.916808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:29.917734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:29.925502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.925972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:29.926820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.927259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:29.962653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-462af67f-2bda-435b-8296-461d2b8c7c9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049774 Jun 15 10:30:29.963240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 580/1063] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:29.968300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:29.970016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:29.976555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.977045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:29.978149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:29.978593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:30.014145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f86a8cf8-e056-483f-8de4-3a02eebcf232 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049796 Jun 15 10:30:30.014744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 581/1064] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:30.019788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:30.020412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:30.027412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:30.027861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:30.028691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:30.029164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:30.100738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:30.114075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78e15881-7bd0-41a7-85f6-e53d85f4e527 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097910 Jun 15 10:30:30.114994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 582/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:30.939273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:30.940087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:30.946885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:30.947331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:30.948117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:30.948553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.099448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:31.111707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a462ffd-39f5-4bb8-a2b6-5d71ab976351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177181 Jun 15 10:30:31.112845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 583/1066] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:31.121316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:31.122573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:31.132463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.133255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.134528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.135242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.177589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-599e1091-2d35-4209-8357-db7486760e34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063205 Jun 15 10:30:31.178175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 584/1067] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:31.188442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:31.189774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:31.196374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.196821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.197668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.198104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.232946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ab1b1a1-2c3b-44e3-b78c-71755c6a694b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053674 Jun 15 10:30:31.233566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 585/1068] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:31.239317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:31.239929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:31.246538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.246992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.247806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:31.248236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:31.316548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:31.326169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1701d625-dc6c-45df-adc1-0d338f0952cd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091457 Jun 15 10:30:31.327031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 586/1069] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:32.071202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:30:32.072278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:30:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:30:32.130938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:32.131611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:32.139128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.139812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.140650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.142262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.305972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:32.314908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7b2b7c3-30fc-4a02-bb1e-3d105095617f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188073 Jun 15 10:30:32.315519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 587/1070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:32.320702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:32.321700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:32.329436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.329895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.330714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.331157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.366432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-26973fc4-71c5-4be1-bb7c-fac91afe5a9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049820 Jun 15 10:30:32.368505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 588/1071] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:32.372451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:32.373427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:32.381558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.382011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.382863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.383305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.420255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a4252937-6b50-4572-b67e-940954814053 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052139 Jun 15 10:30:32.420840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 589/1072] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:32.426328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:32.426951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:32.433607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.434052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.434882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.435315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.509274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:32.517558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-118e2827-b857-4eea-b855-feae3a177a36 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095561 Jun 15 10:30:32.518142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 590/1073] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:33.335726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:33.336460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:33.343537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.344788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.346129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.346566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.506700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:33.515514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a45a6540-3307-4a55-a71d-eea3503f1148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.184177 Jun 15 10:30:33.517241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 591/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:33.526667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:33.526667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:33.532244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.532856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.533979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.534428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.569539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba235ecd-25e4-44b9-b3f6-b607e14e7afa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050943 Jun 15 10:30:33.570196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 592/1075] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:33.575142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:33.576305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:33.584188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.584643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.596019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.596019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.618604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6bfa1fa7-b5cd-455b-beb6-814effefc60d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Jun 15 10:30:33.619190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 593/1076] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:33.623917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:33.624549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:33.632075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.632524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.634553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:33.634553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:33.654392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:33.705661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:33.718224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad2bfc46-ea93-461f-abaa-8bfebca56e69 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097543 Jun 15 10:30:33.720532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 594/1077] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:33 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:34.540994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:34.543435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:34.557682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.558596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.560083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.561071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.775397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:34.788316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43379979-12ed-403a-af10-35ad7cbb6397 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.255042 Jun 15 10:30:34.789273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 595/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:34.799249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:34.800929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:34.810744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.811420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.812508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.813358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.857025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5712171d-f553-400c-bd53-47299791c506 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066213 Jun 15 10:30:34.857672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 596/1079] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:34.862842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:34.863784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:34.870850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.871300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.872101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.872541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.907276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a24aea61-e1bb-4df5-a55d-dbbf64d01124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048425 Jun 15 10:30:34.907910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 597/1080] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:34.913483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:34.913483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:34.920211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.920660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.921490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:34.921925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:34.992615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:35.007499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ace42168-6f6b-48ed-9ac3-520acae852ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098111 Jun 15 10:30:35.008534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 598/1081] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:35.817445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:35.818563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:35.827405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:35.828066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:35.829499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:35.830255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.021163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:36.032731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75ddbe10-8ff4-401d-b973-4d2e13227b06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.220539 Jun 15 10:30:36.033392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 599/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:36.040088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:36.041591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:36.052507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.053087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.054019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.054775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.106735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7e04bca-997f-4952-8887-67d6bb0b14dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070875 Jun 15 10:30:36.107862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 600/1083] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:36.117375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:36.119084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:36.130852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.131625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.133093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.133847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.193846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5efb1252-0d6c-4468-9ef8-1752f5feddc7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084048 Jun 15 10:30:36.194896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 601/1084] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:36.204204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:36.205425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:36.217202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.218000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.219513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:36.220313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:36.319761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:36.331003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c303527c-558b-45e5-bd63-5b3e4eabf57e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.134633 Jun 15 10:30:36.331588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 602/1085] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:36 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:37.052148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:37.053138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:37.060630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.061110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.061902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.062332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.261717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:37.274679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36704a8f-fa1d-4ef3-a547-7bab0f103dbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.227320 Jun 15 10:30:37.275632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 603/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:37.283418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:37.284625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:37.292261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.292805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.293611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.294043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.333327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-453f8923-0b50-403a-bed4-c9aeaf891dc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055931 Jun 15 10:30:37.334145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 604/1087] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:37.342991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:37.346018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:37.354237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.354676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.355460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.355900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.394038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9138f706-fe2f-4ed6-b830-02363f0fae4b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058432 Jun 15 10:30:37.394904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 605/1088] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:37.399661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:37.400275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:37.408589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.409054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.409861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:37.410336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:37.498514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:37.510441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-afef8c4b-1ffc-4471-812c-b9c60a3e341a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.114691 Jun 15 10:30:37.511251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 606/1089] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:38.299878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:38.301034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:38.314457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.315332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.316745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.317516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.528862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:38.543684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-93495ea3-c579-4744-a75d-8a3a15db6aca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.251755 Jun 15 10:30:38.549753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 607/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:38.555003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:38.556569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:38.568604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.569466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.570892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.571679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.635317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0babb1c0-7592-4c24-8642-bf42a8fcb6b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088561 Jun 15 10:30:38.636419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 608/1091] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:38.646411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:38.648002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:38.659472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.660292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.661655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.662404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.710321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e937a9b-479e-4454-b7f2-f54e8e2ecd06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072207 Jun 15 10:30:38.711069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 609/1092] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:38.717562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:38.718240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:38.728039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.728697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.729919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:38.730654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:38.823696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:38.834367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d467f92f-4623-4b4a-8152-94c714c306c6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.121914 Jun 15 10:30:38.835022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 610/1093] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:38 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:39.567703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:39.568509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:39.575365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.576457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.576641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.577042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.583059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:39.774329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:39.785693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9489142-3eb6-4045-9d80-41c87bc24cf6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.223102 Jun 15 10:30:39.786555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 611/1094] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:39.792191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:39.793676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:39.802760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.803203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.804041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.804636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.842305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07091b14-f22e-429e-a6e9-06f3ab47bfe5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054474 Jun 15 10:30:39.842887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 612/1095] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:39.849150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:39.850106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:39.856786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.857266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.858059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.858488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.903889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-638748e8-6dc2-46ee-8ee6-87346aa1bcd7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059572 Jun 15 10:30:39.904917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 613/1096] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:39.913034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:39.913765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:39.923101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.923733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:39.924752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:39.925353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:40.011662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:40.023286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d72fe59a-0544-4e6f-a974-eeb57b19a085 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.116786 Jun 15 10:30:40.023980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 614/1097] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:40.808572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:40.809298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:40.818947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:40.819663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:40.820761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:40.821399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.010419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:41.021998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e23d022-319c-4c4d-85fb-294a50a7364a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.219910 Jun 15 10:30:41.022989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 615/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:41.029827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:41.030781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:41.040867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.041647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.043118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.043975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.092223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9efafca8-af78-4c51-9330-02b9cc23cec1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067615 Jun 15 10:30:41.092710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 616/1099] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:41.101056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:41.102320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:41.112216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.113011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.114394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.115131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.154881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b153831-8981-4e53-982b-25c8015e2319 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060768 Jun 15 10:30:41.155832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 617/1100] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:41.162442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:41.163070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:41.171262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.173090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.174607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:41.175601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:41.282381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:41.294584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-967b90bb-0e21-4543-b84d-0c1f51cfa59b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.136517 Jun 15 10:30:41.295367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 618/1101] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:41 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:42.043889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:42.045048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:42.055378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.055970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.057206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.061654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.255952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:42.271423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a20893f2-a02a-4118-b266-52d848dd7f34 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.234482 Jun 15 10:30:42.275588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 619/1102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:42.281150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:42.282072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:42.292073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.293069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.294565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.295299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.337797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-90c1855f-a2a9-4985-a1f1-a293910a77cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060905 Jun 15 10:30:42.338763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 620/1103] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:42.343893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:42.345713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:42.352767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.353257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.354068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.354512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.390083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cae1eb83-2580-43af-a06f-fe4116313457 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050187 Jun 15 10:30:42.390675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 621/1104] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:42.397450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:42.398061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:42.405464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.405908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.407252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:42.407688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:42.482421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:42.496188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2e48145-a068-46e0-8d61-589f281c1d26 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.102276 Jun 15 10:30:42.497281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 622/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:42 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:43.301677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:43.302734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:43.315086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.315827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.317235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.317969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.551251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:43.566262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9143530-0eaa-49df-a092-ff7875b997e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.272597 Jun 15 10:30:43.567552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 623/1106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:43.583406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:43.584932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:43.592509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.593062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.593820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.594969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.642369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36bc81ea-06cc-41c7-929d-93c2d68c8257 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064305 Jun 15 10:30:43.643050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 624/1107] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:43.648031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:43.649008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:43.655948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.656420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.657240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.657725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.693389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50200b5b-628f-4061-80de-aa276700bcee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Jun 15 10:30:43.694522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 625/1108] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:43.873103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:43.873993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:43.884220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.884801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.886088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:43.886747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:43.980517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:43.989778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-821e7ef4-f76f-4006-b0d4-a6f6670654d3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.294652 Jun 15 10:30:43.990767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 626/1109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:43 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:44.593983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:44.595574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:44.598012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:44.603324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.603766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.604545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.604990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.759841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:44.764196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:44.771259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de8908fd-3af4-4e2d-b5b4-005d0899d2d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.181119 Jun 15 10:30:44.771848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 627/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:44.777019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:44.778109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:44.785833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.786271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.787056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.787484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.822818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5f3ce14e-d244-4cd7-90fa-7b741e9ef65b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049759 Jun 15 10:30:44.823321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 628/1111] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:44.829320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:44.830486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:44.837502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.837947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.838739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:44.839174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:44.873692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a893c81-6970-40ef-96a3-09f77b930684 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 Jun 15 10:30:44.874472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 629/1112] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:45.013874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:45.014494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:45.021819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:45.022379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:45.023172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:45.023614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:45.096056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:45.105721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4249a327-2a45-4263-8143-cd98cc714cb4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094643 Jun 15 10:30:45.106134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 630/1113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:45 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:45.790401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:45.792236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:45.803653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:45.804256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:45.805246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:45.805828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:45.983011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:45.991805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99c07e38-e33c-4eef-8c23-6be107aeaf55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.205270 Jun 15 10:30:45.992495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 631/1114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:45.998208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:45.999313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:46.006375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.006828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.007602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.008043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.053521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3730534-c545-4da9-b63d-db1f339aa343 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059174 Jun 15 10:30:46.054403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 632/1115] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:46.063889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:46.065547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:46.076644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.077453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.079374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.080182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.116771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52a5c402-e5ff-475f-a6f8-fca8f6c6a706 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060873 Jun 15 10:30:46.117743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 633/1116] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:46.123089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:46.123742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:46.131002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.131453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.132244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:46.132677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:46.204539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:46.214694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-37c7b0a1-e45b-406b-b6e9-9d834a194b40 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095672 Jun 15 10:30:46.215593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 634/1117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:47.011865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:47.012880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:47.020056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.020714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.021592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.022075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.220008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:47.228811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7216bdf8-448f-4cda-aa04-30f2b271ce58 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.220914 Jun 15 10:30:47.229469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 635/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:47.235252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:47.236278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:47.245656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.246347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.247730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.248484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.285944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-188e1f1c-e4f4-43af-bb31-5f894a10cafe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055257 Jun 15 10:30:47.286452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 636/1119] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:47.291392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:47.292370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:47.299929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.300382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.301227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.301678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.337873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cec349af-b40f-4c82-a113-a58552c08ab7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050311 Jun 15 10:30:47.338573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 637/1120] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:47.343372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:47.344045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:47.350660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.351121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.351915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:47.352354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:47.420573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:47.429909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ef487ca7-ecd8-4e2c-b053-80852292fd1c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090200 Jun 15 10:30:47.430496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 638/1121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:47 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:48.250344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:48.251382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:48.261767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.262344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.263255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.266255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.422637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:48.431032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ecbc5536-16da-4cdc-b6ae-bfa3b3b30b24 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.184791 Jun 15 10:30:48.431642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 639/1122] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:48.436660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:48.437685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:48.444642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.445305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.446157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.446601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.482864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-671a430e-2da8-4784-bc80-e3d522ebd5fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050052 Jun 15 10:30:48.483473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 640/1123] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:48.488765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:48.489731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:48.496395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.496843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.497688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.498203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.536276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb24a310-7919-4d9b-a81f-df2aff12d22e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051598 Jun 15 10:30:48.536783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 641/1124] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:48.541728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:48.543721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:48.549266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.549822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.550648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:48.551114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:48.619161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:48.627521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8570c22-9fdf-4fc5-ac20-1b94ada85b66 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089624 Jun 15 10:30:48.628108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 642/1125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:48 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:49.455029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:49.455741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:49.465972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.466428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.467245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.467677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.630062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:49.641508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-975341d8-7e3b-48f0-95ae-0481dfa1c29e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.187669 Jun 15 10:30:49.641508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 643/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:49.645279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:49.651295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:49.653666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.654112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.654889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.655323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.676534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:49.691905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b70179e5-01d7-4f6a-b3f6-525a5b6cb9fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051319 Jun 15 10:30:49.692584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 644/1127] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:49.697761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:49.698705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:49.706198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.706553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.707600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.708033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.741973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5597f950-5bf4-4784-8907-ad3935e05c46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048159 Jun 15 10:30:49.742568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 645/1128] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:49.747740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:49.748371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:49.755094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.755553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.756370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:49.756795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:49.823536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:49.832714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5825b556-5d02-4256-b709-74bc813a9bed tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088801 Jun 15 10:30:49.833383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 646/1129] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:49 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:50.666854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:50.667759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:50.675065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:50.675617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:50.676498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:50.677050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:50.941138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:50.950005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-514fed84-e16d-4204-a10b-d1fc269930d9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.287549 Jun 15 10:30:50.950602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 647/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:30:50.957073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:50.958372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:50.964920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:50.965558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:50.966404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:50.966685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.023000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-975f30fa-42bd-4fb7-a38d-c434af7e260f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070863 Jun 15 10:30:51.024053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 648/1131] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:30:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:30:51.032781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:51.033840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:51.040586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.041059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.041939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.042426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.078282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c528dc1f-5d4e-4f49-b4ac-fb6e407107bb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052312 Jun 15 10:30:51.083439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 649/1132] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:30:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:30:51.084251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:51.084918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:51.091781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.092226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.093047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.093491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.175602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:30:51.189826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cbbb7b45-1e37-4e19-b251-67deb4740842 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.109139 Jun 15 10:30:51.190912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 650/1133] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:30:51 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:30:51.485087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:30:51.486063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:30:51.492591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.493074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:51.493895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:51.494331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:01.490071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=49 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:01.516865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=42 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:29.284022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:31:29.285704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:31:29.288603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3b906bc-e412-4bce-b195-2d23d466072d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:29.290862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:31:29.294230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 409 to user: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:29.297160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-442373c4-87c0-4ca7-bb7a-c5826f2e908c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 409 len: 152 microversion: 2.1 time: 97.867435 Jun 15 10:31:29.297160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 484/1134] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:29:51 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 152 bytes in 97869 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:31:29.297160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:29.297160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:29.301384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.302742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.303548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.304197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.448337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:29.461840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4432b82-5494-4d19-a233-9dae6e3112b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.172016 Jun 15 10:31:29.462885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 485/1135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:29.472391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:29.474216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:29.486829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.487515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.488897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.489723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.554316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-225d8715-0028-42a3-98c8-1fb51cf26dd0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089530 Jun 15 10:31:29.555407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 486/1136] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:29.565799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:29.567471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:29.579619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.580398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.581826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.582602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.627813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88105abf-347c-4b15-b52e-0fa8bbcd3138 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070775 Jun 15 10:31:29.628571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 487/1137] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:29.633973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:29.634733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:29.642634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.643080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.643903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:29.644336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:29.714605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:29.729438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf8b79f6-0d23-478b-83cd-46142fdd78db tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.099390 Jun 15 10:31:29.730264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 488/1138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:29 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:30.480748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:30.481802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:30.489470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.489915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.490694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.491121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.646241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:30.654881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3cde3826-f27b-48e4-bc5e-6f4df07fe77e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.178090 Jun 15 10:31:30.656112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 489/1139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:30.661405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:30.662386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:30.669802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.670450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.671302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.672427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.707941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78bafb96-978b-4043-be00-6470bab7ba50 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050673 Jun 15 10:31:30.708852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 490/1140] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:30.714612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:30.715673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:30.723361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.723859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.724729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.725324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.761043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-39443e04-22aa-42ff-bd7d-c9a2dbf35507 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050810 Jun 15 10:31:30.761536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 491/1141] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:30.766350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:30.767036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:30.773847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.774299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.775127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:30.775567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:30.873160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:30.883777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-07b0f816-0225-4d4c-ac02-0f020d18dccb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.121078 Jun 15 10:31:30.884454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 492/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:31.676241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:31.676986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:31.685202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.685652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.686457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.686990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.839264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:31.848119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f4c2b41-14e3-49f7-8c3a-01674019c6f3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177974 Jun 15 10:31:31.848740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 493/1143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:31.853844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:31.854778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:31.861597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.862042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.862819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.863249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.895616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3eb8b890-a9d8-47e3-8b50-25cd26c677e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045736 Jun 15 10:31:31.896184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 494/1144] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:31.901094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:31.902026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:31.909182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.909625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.910406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.910838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.944885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-147fe7e6-a5e1-4019-bdc6-7acb9141c173 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047594 Jun 15 10:31:31.945655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 495/1145] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:31.950445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:31.951055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:31.958264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.958715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.959494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.959925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:32.027719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:32.036316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0de2c8e4-dbcf-468c-8b7e-caadbdb03299 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089395 Jun 15 10:31:32.036928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 496/1146] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:32.870848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:32.871833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:32.884574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:32.885416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:32.886843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:32.887629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.070356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:33.083977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1acf253-a850-4e8c-b7c7-0c790b262799 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.220058 Jun 15 10:31:33.085051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 497/1147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:33.094434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:33.095976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:33.105664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.106310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.107400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.108187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.165347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79171d86-3060-43bb-9ba2-72458da13e35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078284 Jun 15 10:31:33.166215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 498/1148] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:33.175010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:33.176585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:33.188558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.189375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.190833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.191620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.230250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-927f6d9e-ce77-4ec2-bc1f-69916e928b60 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062549 Jun 15 10:31:33.231128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 499/1149] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:33.236280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:33.236982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:33.243549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.243992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.244774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.245248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.312751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:33.320940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-297dbbd0-adbb-4618-8ad2-8e33a2699044 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088660 Jun 15 10:31:33.321724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 500/1150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:33 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:34.102676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:34.103475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:34.110702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.111155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.111941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.112373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.117484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:34.263889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:34.273053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d36c1b7-d867-4205-8bff-12b34c2316f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174511 Jun 15 10:31:34.274166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 501/1151] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:34.279246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:34.280206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:34.287907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.288378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.289212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.289646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.323624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc52d85e-70f8-40da-bfdf-9a174f614de2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048334 Jun 15 10:31:34.324213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 502/1152] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:34.330122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:34.331063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:34.338368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.338811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.339613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.340048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.373843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8eab25d9-6cbd-4988-9364-b236fa33c7cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048440 Jun 15 10:31:34.374357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 503/1153] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:34.380003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:34.380627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:34.387387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.387826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.388613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:34.389081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.458287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:34.468318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3083f04e-4660-456c-9443-282287e982d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092170 Jun 15 10:31:34.468902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 504/1154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:35.292869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:35.293766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:35.301437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.301881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.302702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.303134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.463122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:35.471472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74460151-33c7-48ff-b7f1-39c1e89f5a89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.182516 Jun 15 10:31:35.472061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 505/1155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:35.477037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:35.477973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:35.485897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.486356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.487139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.487572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.528426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6899e7e-ae58-4f0b-b4b3-865aeb0e843c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055259 Jun 15 10:31:35.529027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 506/1156] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:35.533975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:35.534912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:35.541551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.542004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.542787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.543289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.578028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4eb9632-08fd-4b5b-b67e-9498dc6fcc56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Jun 15 10:31:35.578799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 507/1157] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:35.583781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:35.584570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:35.590999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.591483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.592302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.592774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.662205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:35.673026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ac7f1c7-fbb2-4c90-bfd9-4d29255a2003 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092458 Jun 15 10:31:35.673627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 508/1158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:36.489839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.490645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:36.498004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.498434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.499205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.500779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.653946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:36.663135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3ccf9cf-859b-4690-b8c9-ad75a78682ea tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177287 Jun 15 10:31:36.663727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 509/1159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:36.668720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.669691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:36.676619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.677094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.677869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.678300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.715203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f1336e2-5b94-463a-9d9b-bbf05067cfa2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050347 Jun 15 10:31:36.715789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 510/1160] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:36.721085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.722031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:36.728907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.729384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.730174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.730611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.766304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-60dcc955-c3aa-482d-a83b-011f93e692d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048408 Jun 15 10:31:36.766954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 511/1161] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:36.775008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.775680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:36.782634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.783083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.783884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.784324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.849140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:36.857535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f93e693b-5aaf-469e-8a35-7bd4b5a27a5c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089086 Jun 15 10:31:36.858276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 512/1162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:37.686569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.688003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:37.695186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.695687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.696596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.697428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.872547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:37.880779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4d511187-6301-491c-be75-855f94ef2960 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.198380 Jun 15 10:31:37.881468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 513/1163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:37.886629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.887556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:37.894578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.895098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.895987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.896509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.929112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-12c9da3d-9672-425f-9a8f-b6c8563e671c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046492 Jun 15 10:31:37.929689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 514/1164] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:37.934422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.935332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:37.941978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.942417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.943264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.943698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.979106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a83775e8-941f-4b60-83e8-c5557a8685dc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048315 Jun 15 10:31:37.979681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 515/1165] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:37.984716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.985465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:37.992007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.996296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.996296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.996296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:38.062387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:38.072137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56cd17c4-d9df-4ba3-bf2a-619cec444bb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091368 Jun 15 10:31:38.072755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 516/1166] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:38.899235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:38.899923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:38.907195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:38.907640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:38.908405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:38.908836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.058554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:39.063316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:39.068186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7afaa06e-2cdb-4933-8ca5-93778f76f6b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.172989 Jun 15 10:31:39.068778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 517/1167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:39.073784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:39.074801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:39.086363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.089061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.089061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.089669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.124934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23dc57c4-131a-40f8-ace7-6964ec494f13 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054449 Jun 15 10:31:39.125958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 518/1168] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:39.130842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:39.131765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:39.138384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.138825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.139597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.140627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.174219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f1f3e430-2f70-4441-bec8-e8534bb8186f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047160 Jun 15 10:31:39.174846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 519/1169] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:39.179442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:39.180080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:39.187696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.188150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.189168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.189605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.462873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:39.477449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90d30c9c-a731-4c1c-a7c9-18199e3b1e84 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.301141 Jun 15 10:31:39.478185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 520/1170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:40.097351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:40.098023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:40.105296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.105744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.106524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.106959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.256066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:40.264044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-805bd5ed-5903-41c2-adab-72374734004b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170724 Jun 15 10:31:40.269870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 521/1171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:40.270079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:40.271088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:40.277690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.278141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.278921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.279356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.313525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa940c34-4e40-4a49-9c4d-7b69b57affad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047742 Jun 15 10:31:40.314206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 522/1172] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:40.319241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:40.320175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:40.326800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.327416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.328374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.328916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.363037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3419e6d4-eaab-44f4-9270-56de01774c65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047589 Jun 15 10:31:40.363595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 523/1173] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:40.500015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:40.501206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:40.512300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.513121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.514582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.515928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.612671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:40.621528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e45f378e-a6aa-480c-9f11-522f587ad0d7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.129669 Jun 15 10:31:40.622031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 524/1174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:40 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:41.287390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:41.288202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:41.295993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.297639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.298684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.299167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.464264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:41.473264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9b549599-b184-4758-8065-ec21371b71e6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.189961 Jun 15 10:31:41.474068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 525/1175] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:41.485415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:41.486338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:41.493463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.493918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.494696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.495127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.530552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3d2c3a4-0f0f-43a6-9f12-178fec845ace tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049823 Jun 15 10:31:41.531782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 526/1176] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:41.536774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:41.537794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:41.546799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.547381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.548408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.548949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.587838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa740179-cf3c-4ad4-b663-b52c763a2d97 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054945 Jun 15 10:31:41.588428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 527/1177] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:41.639137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:41.639774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:41.646574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.647012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.647829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.648382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.730686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:41.739330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f387d903-e135-4d32-88c8-7526ada30e71 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.104388 Jun 15 10:31:41.739930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 528/1178] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:41 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:42.491510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:42.492232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:42.499971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.500409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.501233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.501658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.675548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:42.683989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4d745fb9-1640-41c7-906e-a684f7095453 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.196660 Jun 15 10:31:42.684644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 529/1179] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:42.691307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:42.692449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:42.699519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.700003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.700732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.701198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.737561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edfc3d65-f8f1-41bb-a9e1-4ecf241f7ad2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051583 Jun 15 10:31:42.738147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 530/1180] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:42.743260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:42.744090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:42.752144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.752587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.753401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.753829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.788483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-650232a6-1774-422c-b530-a10f0825bbe5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049236 Jun 15 10:31:42.789098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 531/1181] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:42.793910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:42.794596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:42.801621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.802060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.802840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.803271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.891444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:42.899983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db43bc9d-49e5-4fda-a5ac-ffef35908bca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.109738 Jun 15 10:31:42.900573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 532/1182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:42 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:43.706044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:43.706722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:43.714061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.714509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.715305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.715741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.879754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:43.894882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ada1b7b2-40dd-47c9-9921-fec364f04858 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193288 Jun 15 10:31:43.895949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 533/1183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:43.905231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:43.907504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:43.912714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:43.919564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.920360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.921816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.922559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.957610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:43.984369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5a428bba-4209-4e33-871a-8e079be2d320 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086521 Jun 15 10:31:43.985267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 534/1184] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:43.990307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:43.993238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:43.998829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.999800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.001023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.001469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.059634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ceebb69-93f0-4675-add6-9c8d1ac07ed7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072906 Jun 15 10:31:44.060682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 535/1185] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:44.069864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:44.070994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:44.082537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.083592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.085009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.085773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.178513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:44.187503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-538e87b6-a09c-4e56-9369-a5ed51262393 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.125198 Jun 15 10:31:44.188164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 536/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:44 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:44.348480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:31:44.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:31:44.353339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3b906bc-e412-4bce-b195-2d23d466072d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:44.355055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:31:44.358140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 409 to user: Cannot 'detach_volume' instance d3b906bc-e412-4bce-b195-2d23d466072d while it is in vm_state rescued {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:44.360914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5dee0af-35a8-4e28-85b3-6f27659760f0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 409 len: 152 microversion: 2.1 time: 52.872076 Jun 15 10:31:44.360914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 651/1187] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:30:51 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 152 bytes in 52879 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 10:31:44.364783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:44.365342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:44.372175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.372618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.373548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.373977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.631821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b8a2573a-005c-461c-bff3-b66e17231dee tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action" status: 202 len: 0 microversion: 2.1 time: 0.271292 Jun 15 10:31:44.632947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 537/1188] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:31:44 2022] POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:31:44.648838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:44.650000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:44.662893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.663688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.665153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.665942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.918521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:44.923098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:44.925970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:44.938146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.938486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f98df03-5b30-4970-a0bb-5e900ef46342 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1721 microversion: 2.1 time: 0.296655 Jun 15 10:31:44.939372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.940869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.941706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.945285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 652/1189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:45.005626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:45.006789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:45.014247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.014696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.016031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.016516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.054296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a70e5e38-89ff-4c05-bf30-9221378f86be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053510 Jun 15 10:31:45.059242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 653/1190] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:45.074517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:45.075446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:45.083732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.084401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.085544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.085988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.127888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-71f3035c-0198-48d8-b039-0d595b6e329f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057873 Jun 15 10:31:45.133997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 654/1191] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:45.195358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:45.206055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:45.206675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:45.207625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b3477e3-1b57-4c3e-9ede-032e4e0b9125 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.296149 Jun 15 10:31:45.209755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 538/1192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:45.214359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.214801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.215589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.216016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.301790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:45.316410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfc88925-8356-4d14-809b-7836782db549 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.114047 Jun 15 10:31:45.320568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 655/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:45 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:45.963136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:45.966262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:45.971176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.971623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.972401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.972832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.070448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.071729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.085438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.086165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.087544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.088355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.147839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17c492b7-7a45-46af-8f03-809afabbbd95 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083340 Jun 15 10:31:46.148616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 656/1194] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:31:46.157999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.158957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.160263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.165743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.166281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.167293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.167735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.175768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-251e1ff3-4752-4bad-86fb-930be7df79cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1721 microversion: 2.1 time: 0.216212 Jun 15 10:31:46.176803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 539/1195] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:46.204018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a490f8f-9177-4772-a168-32d5176ba796 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052613 Jun 15 10:31:46.204622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 657/1196] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:46.238476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.239491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.248132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.248642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.249755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.250552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.342050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.342824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.350426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.350873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.351708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.352205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.429332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.430329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.438303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43023eda-4c23-419e-a5d9-e2f8b98fb7fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.099906 Jun 15 10:31:46.438963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 658/1197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:46.445496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e42d436-1e70-4000-af40-ae97f35c209c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.214543 Jun 15 10:31:46.446565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 540/1198] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:47.163284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.164619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.173689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.174211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.175226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.175813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.204092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.205718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.214450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-986c1a81-4c1c-489c-9bf4-ee08fa713eb8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055675 Jun 15 10:31:47.215040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 659/1199] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:47.216063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.216707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.217695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.220146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.221216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.222139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.229131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.229573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.230368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.230802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.264210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-60e6d0a9-74a0-49a5-ae39-b3db1817fbb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048090 Jun 15 10:31:47.274139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 660/1200] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:47.456757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.457444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.464789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.465256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.466042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.466475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.512644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.522519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47147555-f3c5-4c4a-97fd-b85173b41f84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1721 microversion: 2.1 time: 0.324979 Jun 15 10:31:47.525985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 541/1201] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:47.537571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.539123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.548906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.549473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.550297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.550732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.643768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.652564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d36bbe5-2ff0-4902-bf08-596c2757625e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.200644 Jun 15 10:31:47.653366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 661/1202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:47.711318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.721049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50a3c53e-d542-4449-9648-72e495ef59a3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.192940 Jun 15 10:31:47.721743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 542/1203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:48.229650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.230714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.238481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.239081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.239982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.240509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.275911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a9128aba-ede4-4f4e-ac6f-bcaf150139b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050428 Jun 15 10:31:48.276512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 662/1204] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:31:48.284676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.285703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.293177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.293758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.294661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.295188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.333914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ef24f689-2f1d-4114-b3c1-7a523530ccda tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053637 Jun 15 10:31:48.334506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 543/1205] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:48.551877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.552519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.559756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.560201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.561111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.562071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.681218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.682450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.695344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.696154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.697705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.698783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.743690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.754569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a2dd943-4f5c-49b4-a960-11c942ddcb6f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1727 microversion: 2.1 time: 0.206923 Jun 15 10:31:48.755489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 663/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:48.761272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.762060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.771271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.772039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.773136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.773739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.789285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.800691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7894260e-0161-4c90-b1a1-f4e3933ed6f3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.126900 Jun 15 10:31:48.802352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 544/1207] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:48.811269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.813862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.823313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.823918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.824890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.825512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.940810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-108fb2b8-618a-4aad-8da8-1d8b76e331b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137441 Jun 15 10:31:48.942051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 545/1208] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:48.942765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.952813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4cabbbe1-79f2-4459-9ed5-d7859ebff0be tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.195241 Jun 15 10:31:48.955923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 664/1209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:49.291096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.292393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.301930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.302518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.303609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.304143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.347502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4baf2d8-f6ea-4c97-9bd1-a53ca934ed60 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060354 Jun 15 10:31:49.348820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 546/1210] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:49.351885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.353949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.366909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.368086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.369672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.370469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.432114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-054561c9-cf62-4cbb-a0f0-54895129022e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088392 Jun 15 10:31:49.433249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 665/1211] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:49.828217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.828843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.835862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.836317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.837192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.837639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.925271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.933660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1276f2d7-b7ef-4d2e-9743-8a30b5860eca tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.110684 Jun 15 10:31:49.934342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 547/1212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:49.972896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.973718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.983764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.984608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.986069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.986906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.214239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-27c7d818-adeb-4b05-9769-b0db4c339d8f req-7654f504-2787-4a0f-8a8d-fc49dc35d739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:50.232808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-27c7d818-adeb-4b05-9769-b0db4c339d8f req-7654f504-2787-4a0f-8a8d-fc49dc35d739 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.234420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-27c7d818-adeb-4b05-9769-b0db4c339d8f req-7654f504-2787-4a0f-8a8d-fc49dc35d739 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.249437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.263043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-27c7d818-adeb-4b05-9769-b0db4c339d8f req-7654f504-2787-4a0f-8a8d-fc49dc35d739 service nova] Creating event network-changed:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:31:50.265246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9847a9d7-80a6-4a85-bbc7-bf783b31bd81 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.297365 Jun 15 10:31:50.266653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 666/1213] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:50.272372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-27c7d818-adeb-4b05-9769-b0db4c339d8f req-7654f504-2787-4a0f-8a8d-fc49dc35d739 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065407 Jun 15 10:31:50.274111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 548/1214] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:50.368471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.370536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.384063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.385053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.386600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.387469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.445633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9efe42f9-ecac-4ebf-9772-dde99f52fba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085372 Jun 15 10:31:50.450067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 667/1215] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:50.450252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.450997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.459007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.459403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.460237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.460669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.496413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2d7f24a4-5794-4ff0-8f66-151ea2091a8a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051872 Jun 15 10:31:50.497617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 549/1216] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:50.952869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.954356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.961619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.962371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.963309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.964828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.971021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:51.287634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:51.288829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:51.299934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.300727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.302521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.303598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.335347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:51.355770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4501aef-0c28-4e66-b85b-fce9118f4306 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.408104 Jun 15 10:31:51.357319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 668/1217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:51.462515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:51.464431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:51.471561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.475007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.475007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.475007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.509964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa06b9a7-b639-4b00-b46d-e1b662397da5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053815 Jun 15 10:31:51.511111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 669/1218] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:31:51.516703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:51.517680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:51.527421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:51.531082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.531532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.532344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.532833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.550892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-717e64d1-ad1d-465b-a6b8-8b3e2c8a22e7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.269819 Jun 15 10:31:51.551485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 550/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:51.575632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e17a12f-7980-44c4-848a-4e0febce30ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063601 Jun 15 10:31:51.579922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 670/1220] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:52.290877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-b6e75828-b71e-49f9-8f5c-79fe25729267 req-ed62660f-3a17-4694-a6b9-f05142f5dced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:52.300813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b6e75828-b71e-49f9-8f5c-79fe25729267 req-ed62660f-3a17-4694-a6b9-f05142f5dced service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.301467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-b6e75828-b71e-49f9-8f5c-79fe25729267 req-ed62660f-3a17-4694-a6b9-f05142f5dced service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.306345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:52.315442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-b6e75828-b71e-49f9-8f5c-79fe25729267 req-ed62660f-3a17-4694-a6b9-f05142f5dced service nova] Creating event network-changed:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:31:52.321205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-b6e75828-b71e-49f9-8f5c-79fe25729267 req-ed62660f-3a17-4694-a6b9-f05142f5dced service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034235 Jun 15 10:31:52.322006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 551/1221] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:52.381721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.382347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.389914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.390439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.391239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.391678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.484683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.494730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c46a789-2350-45ac-8305-6212a0c075f8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.117179 Jun 15 10:31:52.495782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 671/1222] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:52.527259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.528899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.541134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.542128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.543462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.544105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.578571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.579381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.585445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa03413d-cf67-4c61-90c4-89cc9195d633 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065032 Jun 15 10:31:52.586343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 552/1223] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:31:52.590021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.590862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.592382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.595181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.596542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.598266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.611117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.612056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.613610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.614965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.666416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9359fd1f-f06a-4153-a7bb-18590bc0abab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078593 Jun 15 10:31:52.667115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 553/1224] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:52.960360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.975174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b25ba971-fd3f-4c48-928a-7f7d04f80d4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.400851 Jun 15 10:31:52.976249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 672/1225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:53.513976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.515463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.525059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.525851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.527332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.528113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.607231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.609938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.622875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.623600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.625784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.626466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.637210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:53.649569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed708974-87b1-45c5-8f67-18be792d33b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.139954 Jun 15 10:31:53.650528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 554/1226] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:53.678936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.680010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.685829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae2998c0-a2fd-4619-a0ce-58d4d433172e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086779 Jun 15 10:31:53.686997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.687209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 673/1227] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:53.687603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.688287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.688688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.734793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-61b8d498-8437-4c56-a0b7-76f85182319f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060092 Jun 15 10:31:53.735751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 555/1228] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:54.001466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.002090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.008899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.009371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.010158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.010622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.177725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.191694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1256fa99-9280-483e-a49c-9a8110a7fe40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193993 Jun 15 10:31:54.192568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 674/1229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:54.668250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.669057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.678066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.678507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.679285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.679716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.704902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.706627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.719813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.720589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.722026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.722776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.747356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.755976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1647650b-2c08-41b7-89bf-593a124af986 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092004 Jun 15 10:31:54.756671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 556/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:54 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:54.762097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.763288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.770871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.771432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.772262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.772769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.781265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86017ee6-d2dd-43a4-8375-2be7b08ca4b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083912 Jun 15 10:31:54.785154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 675/1231] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:54.809345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e60978a-165b-4c9f-a1f5-51a5bd563831 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051341 Jun 15 10:31:54.810186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 557/1232] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:55.210348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.210974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.217594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.218738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.219519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.219961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.391578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:55.403720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a5ff2a3-37ab-421b-99c5-cc73e57b1482 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.197292 Jun 15 10:31:55.404783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 676/1233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:55.781425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.782355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.790764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.791503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.792749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.793480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.795181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.796468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.803641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.804092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.804881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.805356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.861663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:55.865832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2372f22-cfe0-4e19-ad3e-3d008a016851 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075668 Jun 15 10:31:55.866928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 677/1234] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:55.872743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-886311ad-1ec1-4ee4-b661-979740397504 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095998 Jun 15 10:31:55.873369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 558/1235] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:55.877026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.878721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.891255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.891610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.892933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.893798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.954539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-adf46687-1792-45a6-a12e-81bb84be1673 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085605 Jun 15 10:31:55.955616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 678/1236] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:56.429707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.430599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.437936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.438217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.438870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.439306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.599663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.612177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ae2f000-8994-41b6-acf3-55bcc854e52c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186395 Jun 15 10:31:56.612768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 559/1237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:56.880263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.881268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.890842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.891631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.892902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.893655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.895817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.896841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.905646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.906328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.907215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.907764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.933668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3064a71-2b5d-4324-850b-d200feedec56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057593 Jun 15 10:31:56.934354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 679/1238] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:56.971271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.973017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.982082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.982533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.982689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.983359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.983809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.995935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4295eb0b-d3a3-4a4a-980c-7b0434cdcbb0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.107396 Jun 15 10:31:56.997256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 560/1239] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:57.019290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-83f88db0-ea7e-4fcb-97f3-4c6b18e31c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053261 Jun 15 10:31:57.019891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 680/1240] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:57.635646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:57.636161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:57.643420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.643858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.644629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.645093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.795542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.809181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c92171e2-6d6e-4263-b221-1554fb249915 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177258 Jun 15 10:31:57.810254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 561/1241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:57.946170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:57.947021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:57.954866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.959627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.959627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.959627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.990437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27a071e5-b03e-4995-8113-4cf7e73f3f21 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048301 Jun 15 10:31:57.991019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 681/1242] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:31:58.020984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.021669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.029645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.030959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.032327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.032546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.032892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.033751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.041129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.041816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.042745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.043251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.082488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84f8cfcb-3a73-4e07-9ef2-1c4455abf21a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055163 Jun 15 10:31:58.083698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 682/1243] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:58.107644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:58.116038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-443d66d4-8f3f-461a-8def-48016078a4d9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.099102 Jun 15 10:31:58.116636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 562/1244] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:58.836812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.837418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.847144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.847878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.849288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.850023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.007026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:59.010762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:59.020419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.021001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.024950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.025951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.028574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.045077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4681dbb6-664d-4589-aa82-c60e0e00866d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.212209 Jun 15 10:31:59.046274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 683/1245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:59.046869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:31:59.047441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:31:59.078769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36a78630-40c2-47b7-a3ff-a37627b9e363 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079364 Jun 15 10:31:59.079679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 563/1246] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:31:59.100180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:59.102092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:59.112463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.113421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.114909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.115789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.138075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:59.139209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:59.150274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.150840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:59.151061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.152732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.153366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.158634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57f9bd8d-685e-4a0a-8c44-da2a1c416ce5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065984 Jun 15 10:31:59.159498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 684/1247] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:31:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:59.271694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.287005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9839836a-9f21-4303-85df-0c90d6de50a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.155595 Jun 15 10:31:59.288082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 564/1248] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:59 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:00.064581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.065530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.073551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.074001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.074791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.075224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.093631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.094237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.101793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.102263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.103030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.103460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.160091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28484270-093e-43ed-90d7-fc1100076076 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070699 Jun 15 10:32:00.161192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 565/1249] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:00.182153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.184156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.196531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.197405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.198867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.199666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.240004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.248240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ce34741-6e1c-40b9-b7fb-08ec1a392514 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188596 Jun 15 10:32:00.249568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 685/1250] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:00.257519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b545145-6a09-4b7c-a11a-2187cfea0620 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082854 Jun 15 10:32:00.258663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 566/1251] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:00.318756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.319310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.325892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.326333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.327771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.328205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.397820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.412149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0b52afb7-fc5f-4b48-86b0-df583f21940e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097065 Jun 15 10:32:00.413235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 686/1252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:01.177069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.178061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.185166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.185608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.186961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.188203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.222589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d7e63bf6-4fd9-49d9-b7fc-ea7730b7959f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050586 Jun 15 10:32:01.223164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 567/1253] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:01.267878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.268770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.271018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.272289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.276207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.276654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.277647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.277913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.279258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.279709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.281253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.281784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.305189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:01.326788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50a8d2d8-8bde-4489-8761-0d078762d732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060135 Jun 15 10:32:01.334555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 568/1254] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:01.440450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.440450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.445169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.447344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.447802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.448677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.449342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.454022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6a8355c-c499-422c-b046-1d4e014c8ddf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190824 Jun 15 10:32:01.454614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 687/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:01.521202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.532436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb8637c1-7305-481c-94d8-d3c140647a37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100648 Jun 15 10:32:01.533509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 569/1256] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:02.235060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.236679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.243967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.244422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.245284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.245722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.285444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65cd03d9-e42e-4885-b5a7-2c1ced73436f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054137 Jun 15 10:32:02.286473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 688/1257] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:02.345955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.346935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.354689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.355133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.355915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.356347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.394389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f0823240-e18c-46b0-966b-ddc97040e024 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053117 Jun 15 10:32:02.394976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 570/1258] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:02.473710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.474573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.481910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.482370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.483655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.484087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.552040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.552800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.560545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.561267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.562791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.563449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.649495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.649930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.658026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5cf8560e-d262-466d-bcce-aae98c82dd48 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.110032 Jun 15 10:32:02.658605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33651fa7-c31c-4d9e-a9b5-3b31f8af6157 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.189230 Jun 15 10:32:02.659061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 571/1259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:02.659430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 689/1260] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:03.300412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.301443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.308038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.308486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.309301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.309735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.343455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b267a09-3598-493b-859c-16a89e4da998 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046759 Jun 15 10:32:03.344229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 572/1261] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:03.407791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.408725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.416053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.416510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.417337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.417784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.450956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-61fef4a4-3a82-49b4-b4fa-89699aa04732 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048174 Jun 15 10:32:03.451535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 690/1262] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:03.682394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.683215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.683407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.683571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.690757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.691095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.691302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.691483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.691987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.692163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.692423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.692628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.771917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:03.780688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43b77a2c-75df-489f-8219-8211979ffd64 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.102097 Jun 15 10:32:03.781644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 573/1263] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:03.852280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:03.860780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9f80452-d20d-4e6b-a878-c6e71a51c10e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.182184 Jun 15 10:32:03.861423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 691/1264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:04.465770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.467006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.474756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.475209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.475998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.476433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.504307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.505557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.513584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.514196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.515089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.515619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.526809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f9028f7c-d4af-46b2-97fe-191e0ce2d954 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065094 Jun 15 10:32:04.528155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 692/1265] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:04.550486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05649a84-d123-4fb5-a55c-8eae268bc868 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.199416 Jun 15 10:32:04.551073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 574/1266] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:04.798187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.798809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.805484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.805955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.806730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.807169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.881987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.882763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.884063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.890944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ed2e3a7-c298-451f-bc6e-1b0c2f55d269 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096659 Jun 15 10:32:04.891580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 693/1267] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:04.893644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.894433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.895941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.896739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.058934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.066820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03783354-fb7c-4a58-ad40-383c8bfc265a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.191242 Jun 15 10:32:05.067398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 575/1268] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:05.543648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.545745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.552859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.553347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.554272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.554605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.564271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.565542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.572088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.572528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.573958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.573958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.588046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43b44f86-aa25-4b15-acf6-f2b38cf2da15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050844 Jun 15 10:32:05.588632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 694/1269] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:05.608284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7c143984-bd6e-4709-8bac-5a5c64195d62 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049341 Jun 15 10:32:05.608994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 576/1270] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:05.916070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.916647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.923268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.923720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.924493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.924974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.987960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.995949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c4da008-f31f-402e-b70e-38d1f6386b38 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.083940 Jun 15 10:32:05.996529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 695/1271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:06.085006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:06.085703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:06.093064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.093573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.094386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.094826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.250944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.266118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abe82501-d858-4e2a-89bb-be768156c310 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185060 Jun 15 10:32:06.267195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 577/1272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:06.600050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:06.600950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:06.608989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.609817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.610545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.611029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.621276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:06.622216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:06.629511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.629970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.630764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.631198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.648112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-61c576c1-1068-4eaa-be4a-9356038e398a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051995 Jun 15 10:32:06.648696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 696/1273] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:06.663997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fadd1b63-f269-4c7c-8dd8-6a7921bfaae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046715 Jun 15 10:32:06.664573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 578/1274] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:07.013440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.014153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.021466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.021906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.022687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.023319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.094039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.102126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-deec7ef9-5ac4-4675-8ebd-807687be5bdb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092871 Jun 15 10:32:07.102881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 697/1275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:07.286588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.287494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.294985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.295427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.296887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.297392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.457758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.466549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ede0b0e5-5425-403e-ba62-703b0de9b3b8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185395 Jun 15 10:32:07.467131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 579/1276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:07.661749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.662683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.671198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.671648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.672581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.673065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.678506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.679931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.691084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.691826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.693165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.693874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.731359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f62d55fc-a82c-4d55-94f6-6169debcdc8d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073350 Jun 15 10:32:07.732275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 698/1277] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:07.741844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47a980d9-99db-4f7e-925a-3475a0242849 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068480 Jun 15 10:32:07.742415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 580/1278] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:08.120035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.120659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.128178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.128624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.129460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.129921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.198131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:08.207450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c1deeae7-a1c1-47d1-b876-d3d84da12fcf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091367 Jun 15 10:32:08.208022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 699/1279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:08.485847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.486617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.493801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.494309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.495194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.495659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.647599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:08.656557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd5f55a5-2922-4f3c-9a87-746c072495df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174583 Jun 15 10:32:08.657165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 581/1280] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:08.744265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.745148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.753001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.753475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.754265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.754703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.756169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.757460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.765941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.766674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.768541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.769008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.791662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35120619-b262-41af-a65d-db4a0128aaeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051478 Jun 15 10:32:08.792518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 700/1281] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:08.803784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a89823a3-9950-4a42-b615-4ed8acd8b69a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052138 Jun 15 10:32:08.804429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 582/1282] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:09.224698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.225367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.228472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:09.232042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.241197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.241197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.241197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.254417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:09.304555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.315079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc873396-f07a-436b-aa1d-838d3dec8934 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093907 Jun 15 10:32:09.316011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 701/1283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:09.674841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.675475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.682308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.682746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.683515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.683944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.806745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.807708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.816642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.817250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.818151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.818658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.838950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.849492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4d0c4a6-aa52-4f06-bf6a-d8c0aa7ca38c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.178952 Jun 15 10:32:09.850293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 583/1284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:09.853545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9d882568-e13d-43d9-b607-db57f14c7f61 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051253 Jun 15 10:32:09.854475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 702/1285] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:09.860016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.861557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.865320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:09.869512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.869971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.870936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.871372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.906506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f344f37-7350-4a79-aef4-436a7ff7248d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054751 Jun 15 10:32:09.907091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 584/1286] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:10.334870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.335477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.342321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.343254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.344036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.344470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.412576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:10.421051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-618d1a94-8e58-467a-b320-91d82d85c77b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090170 Jun 15 10:32:10.422091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 703/1287] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:10.869194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.870184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.878458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.878979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.879523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.880002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.880304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.880414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.887972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:10.892483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.898126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.898126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.898126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.942296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddbc0e67-578c-499a-8709-069153b8f2cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076725 Jun 15 10:32:10.943388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 585/1288] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:10.953435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.955155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.966870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.968143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.969611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.970396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.007330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4718584-b0fc-4410-a361-58b7b6dcb7ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062378 Jun 15 10:32:11.007893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 586/1289] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:11.064996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:11.073417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b064d7b-2807-4690-9528-cb4fb89a5f41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.198157 Jun 15 10:32:11.073993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 704/1290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:11.441072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:11.441072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:11.447497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.447953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.448717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.449189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.525877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:11.535935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73d2e055-e2a9-4a7e-b538-afd1b67bf36f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100917 Jun 15 10:32:11.536819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 587/1291] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:11 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:11.955439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:11.956379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:11.963632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.964070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.964856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.965383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.000660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3836183-c793-4329-8d6b-7a6b3ecbb331 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049925 Jun 15 10:32:12.001291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 705/1292] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:12.020643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:12.021773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:12.029257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.029787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.031949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.032435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.068470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0777f7d8-57b9-4e81-913f-bd339ce19801 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051855 Jun 15 10:32:12.069250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 588/1293] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:12.091267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:12.091880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:12.099448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.099889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.100671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.101182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.277928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:12.287352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c1a7050f-10d6-4b12-bc7e-f6796822be2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200160 Jun 15 10:32:12.287945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 706/1294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:12.554608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:12.555221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:12.562449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.562909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.563688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:12.564120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.630797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:12.638987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-59ac3365-4031-4380-9ecf-caea6b0c5375 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088421 Jun 15 10:32:12.640250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 589/1295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:12 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:13.013259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.014222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.022036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.022485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.023274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.023710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.059787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-37675947-01fc-493e-9cbe-4a9b062086e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050714 Jun 15 10:32:13.060400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 707/1296] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:13.081645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.082799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.090445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.090893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.091684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.092163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.126928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c91509f5-1b7c-4d15-b423-d12a09b83653 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049889 Jun 15 10:32:13.127512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 590/1297] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:13.306960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.307500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.315063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.315588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.316408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.316849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.478291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:13.487078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2dc51d25-c3c0-48c3-9491-a0c344e45244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.184205 Jun 15 10:32:13.489395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 708/1298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:13.656183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.657439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.663760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.664207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.665000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.665434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.737058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:13.745669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36115e5e-04b6-47cd-b07d-eda32b78989f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093418 Jun 15 10:32:13.746295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 591/1299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:14.072253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.073264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.081328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.081782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.082587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.083025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.116882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99ec8496-8379-47bc-8047-a5519efd780b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048797 Jun 15 10:32:14.117775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 709/1300] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:14.141178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.142120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.148999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.149457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.150298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.150803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.185142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fabb4905-f158-4e61-bbe3-1bc5d2144cb1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048970 Jun 15 10:32:14.185738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 592/1301] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:14.505939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.510206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.513291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.513746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.514569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.515041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.667631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:14.678522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62b4aa65-cd32-4693-8eda-f2535aead84c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176649 Jun 15 10:32:14.679104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 710/1302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:14.768725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.769255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.775902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.776343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.777173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.777611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.846273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:14.854749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-951b89c0-d555-4403-9a4f-becdcd349725 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090680 Jun 15 10:32:14.855454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 593/1303] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:15.129363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.130315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.139166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.140148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.140970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.141411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.175620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fdb055a8-551b-48d2-a299-6a3b17196cf9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050393 Jun 15 10:32:15.176209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 711/1304] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:15.199836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.201388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.212999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.218359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.218359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.218359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.258027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29bfab32-cf95-43ec-9c95-6c6fc4243fc9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064022 Jun 15 10:32:15.258717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 594/1305] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:15.706180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.706888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.714468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.714909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.715689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.716117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.870313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:15.879537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9aee60bc-7d13-4a50-a073-10c7596f5ed9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.180481 Jun 15 10:32:15.880120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 712/1306] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:15.880353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.881358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.891228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.891679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.892472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.892913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.964201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:15.972604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4d2a89b5-e52a-4e22-a2ab-456f73fffaa7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098911 Jun 15 10:32:15.973227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 595/1307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:16.188237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.189110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.196137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.196580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.197610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.198041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.231307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14efe65f-c76e-4861-8628-1752b2d276ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047730 Jun 15 10:32:16.232170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 713/1308] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:16.270663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.271599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.279110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.284920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.284920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.284920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.319468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2188a3cf-63a5-41ee-af50-a427e88a5a18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049540 Jun 15 10:32:16.319468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 596/1309] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:16.898246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.898775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.906130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.906775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.907626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.908131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.989250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.989865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.996753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.997233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.998003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.998443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.056065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:17.065600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12e35d02-a909-4f22-a7ac-bddabe1e74a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.171263 Jun 15 10:32:17.066854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 714/1310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:17.071359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:17.086054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1886d0bf-386d-492b-8462-f8df3a29e61b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100888 Jun 15 10:32:17.086759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 597/1311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:17.244400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:17.245398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:17.253392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.257256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.257256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.257256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.290971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b09ac2b3-65a6-424f-9cc9-2b9c29af069a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051061 Jun 15 10:32:17.291560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 715/1312] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:17.328757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:17.329757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:17.337242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.337700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.338495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.338934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.374028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1758e6a9-cff3-4774-9b09-4a1a1b5c75a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049664 Jun 15 10:32:17.374623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 598/1313] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:18.095048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.095734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.104893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.105638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.106125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.106912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.107147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.107626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.117188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.117636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.118419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.118853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.184734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:18.193948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fac7f4e7-8433-4076-97cf-fdd64469e7d1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094249 Jun 15 10:32:18.205062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 599/1314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:18.303127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.304297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.306003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:18.310910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.311992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.312793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.313252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.315332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22645b6d-1308-43df-8a9d-87399d8b2adc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.225471 Jun 15 10:32:18.316183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 716/1315] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:18.350981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e038dcaf-c850-44bf-a7db-0c10b4ebbf94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051869 Jun 15 10:32:18.351585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 600/1316] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:18.387237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.388776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.400409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.401249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.402608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.403367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.440053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35c19fab-3402-4a1d-a55b-dd87f46bb6e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057297 Jun 15 10:32:18.440550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 717/1317] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:19.221645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.222358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.229492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.229985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.230854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.231347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.313222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:19.317243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:19.322183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e455a139-f715-4463-a1b2-dca9fca1586f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105791 Jun 15 10:32:19.322772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 601/1318] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:19.338532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.339178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.346662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.347109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.347908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.348347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.353194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:19.364092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.365050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.372625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.373196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.374830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.375160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.409879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3404653-dfbb-4f54-aff6-4212649c0265 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050377 Jun 15 10:32:19.410475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 602/1319] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:19.454333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.455373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.462255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.462699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.463482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.463911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.503731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f1d644ce-cc9d-4217-a83d-573c7881537e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054332 Jun 15 10:32:19.504822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 603/1320] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:19.530810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:19.539012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c14c323-1e95-4756-98f5-913a7776d5a5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.204944 Jun 15 10:32:19.539606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 718/1321] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:20.340045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.340659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.348686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.349252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.350082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.350554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.418331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:20.424853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.425875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.428553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-495b8fa3-9533-46fa-800f-f5dc06856b08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092324 Jun 15 10:32:20.429270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 604/1322] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:20.432862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.433336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.434123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.434549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.472785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f9b7b88c-7498-4b26-b92a-a17d917f3048 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052759 Jun 15 10:32:20.473477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 719/1323] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:20.516387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.517479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.525410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.526141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.527335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.528000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.558476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.559519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.568243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.568868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.569987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.570208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9e3b2be-681f-48ef-abd7-e75d9f20bcbf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057910 Jun 15 10:32:20.570647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.570820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 605/1324] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:20.732483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:20.747383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d977556b-4783-4cfd-ad19-cfc8c9bca3a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.192867 Jun 15 10:32:20.748401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 720/1325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:21.447280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.447902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.456009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.456460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.457429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.457863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.484857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.485828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.493158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.495166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.495166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.495166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.529486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:21.533568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-337cf965-803a-4738-b115-d969d2c06b43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053032 Jun 15 10:32:21.534508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 721/1326] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:21.541169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c40e3520-767e-40f5-b39e-9e1c77e8edf0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097985 Jun 15 10:32:21.541768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 606/1327] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:21.584102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.585290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.592365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.592819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.593760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.629993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4846a051-df34-4203-a88b-9b4c299fc6d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050656 Jun 15 10:32:21.630586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 722/1328] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:21.778164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.779116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.790704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.791499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.792940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.793761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.969721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:21.978535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56cc2d2d-ad68-4186-9af5-e54aee5b1bce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.207754 Jun 15 10:32:21.979225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 607/1329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:22.548078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:22.549162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:22.558513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.558962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.559751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.560191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.561073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:22.562207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:22.570632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.571276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.572195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.572799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.598939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14273453-9ed6-4131-a0b8-1fe518c367aa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057311 Jun 15 10:32:22.599828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 723/1330] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:22.643674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:22.644682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:22.646220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:22.651509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.652076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.653048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.653536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.661111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d814ccb3-877a-4192-9c99-e926259e6949 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.104562 Jun 15 10:32:22.661911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 608/1331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:22 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:22.686764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44023e06-f4ec-4e1f-8016-d1a454dd632a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048308 Jun 15 10:32:22.687526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 724/1332] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:22.997370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:22.997988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:23.004893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.005380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.006165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.006599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.164759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:23.175238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67cbb36a-db30-4ecc-8bde-0728c6df7a71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.181773 Jun 15 10:32:23.175824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 609/1333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:23.613894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:23.614828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:23.621704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.622157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.622942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.623374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.655198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f24e16b9-5557-48bc-8636-d0df91ce8dea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Jun 15 10:32:23.655783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 725/1334] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:23.678221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:23.678890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:23.686005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.687344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.688140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.688590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.698918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:23.699852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:23.706932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.707372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.708213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.708658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.742456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57827172-6399-4f57-9973-d70cd5b8465c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047511 Jun 15 10:32:23.743048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 726/1335] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:23.775930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:23.784857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6733b83-1ffe-40cc-8795-90526f2108df tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.110481 Jun 15 10:32:23.785486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 610/1336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:23 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:24.193843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.194492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.201074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.201625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.202364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.202878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.356092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:24.364778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69c10a67-e5ca-4985-9307-e0a3fbd2f8de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174963 Jun 15 10:32:24.365463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 727/1337] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:24.666894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.667842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.674964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.675410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.676209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.676642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.714888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f542c45-6e6a-4d09-8311-f928a5f0447e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052165 Jun 15 10:32:24.715883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 611/1338] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:24.758015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.758991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.767588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.768035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.768872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.769344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.804682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f572c14-b890-417d-a100-c8a03c18657d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050959 Jun 15 10:32:24.805212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 728/1339] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:24.808448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.809095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.816811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.817301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.818093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.818520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.888524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:24.898827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e5748724-b0cb-4820-a387-ac117681c62f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095061 Jun 15 10:32:24.902280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 612/1340] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:25.382910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.383523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.391365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.391809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.392593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.393063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.536568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:25.545464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6bf67e92-61e5-4c24-a621-d745ebbc692c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.166367 Jun 15 10:32:25.546471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 729/1341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:25.727863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.728793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.738898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.739709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.741131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.741919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.778481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b52b2991-d76d-4e78-a3bb-083d926d608d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054630 Jun 15 10:32:25.779066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 613/1342] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:25.818991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.819926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.827531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.828119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.828948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.829414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.863817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2592c1c0-eb60-49a6-b6e5-13dc49fa1985 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048872 Jun 15 10:32:25.864400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 730/1343] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:25.918107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.918713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.925701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.926146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.926921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.927351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.992025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:26.001399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5fd93b07-5efd-429e-844c-c6482249df54 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.087496 Jun 15 10:32:26.002056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 614/1344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:26.564519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:26.565178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:26.572042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.572494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.573327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.573764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.736636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:26.745305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10e5b451-259a-4678-b2c1-107ce54b5964 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185463 Jun 15 10:32:26.745888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 731/1345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:26.791134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:26.792068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:26.799185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.799539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.800311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.800740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.836132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dedfb720-94ab-4f54-83c0-449280906ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049204 Jun 15 10:32:26.836798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 615/1346] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:26.876664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:26.877621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:26.884749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.885382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.886172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.886607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.925807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-760b9c6a-9466-4e35-8eb7-99e19094070f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053203 Jun 15 10:32:26.926937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 732/1347] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:27.023667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.024563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.033967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.034643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.035557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.036128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.106457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:27.122053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b941771-f647-49ca-8197-d31d101ea3ae tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105321 Jun 15 10:32:27.123134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 616/1348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:27.771199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.771835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.778935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.779449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.780919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.781445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.852276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.853845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.865646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.869513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.869513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.869513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.921877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-35d9b5ac-e3b2-4d1c-9e23-6857fef2b0d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076602 Jun 15 10:32:27.922907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 617/1349] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:27.940763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:27.943022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.944502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.955058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04bacfe5-5764-4c51-971e-5b2b9e5a3852 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.187410 Jun 15 10:32:27.955326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.955759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.956405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 733/1350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:27.956938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.957487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.978648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:27.997257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ad8c7dd-68e2-4b7a-8122-ecb4e389884f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062081 Jun 15 10:32:27.998237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 618/1351] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:28.149533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:28.150076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:28.157644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.158094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.158886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.159328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.227560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:28.231561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:28.238247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed2deeb5-a7cc-451d-a5ac-995b28c1cd46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092904 Jun 15 10:32:28.238895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 734/1352] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:28 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:28.937108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:28.937958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:28.946299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.946754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.947557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.947999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.974517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:28.975112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:28.982246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.982726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.983213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67486673-c816-4ddc-85d7-cc93936d0146 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050596 Jun 15 10:32:28.983807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.984012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 619/1353] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:28.984289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:29.011011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:29.012113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:29.021806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:29.022635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:29.024096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:29.024852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:29.082611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37dbc4e1-7b5d-40e6-b323-b4d9bea29de8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075536 Jun 15 10:32:29.087476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 620/1354] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:29.177027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:29.192741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf64bed1-95d3-472f-9643-b1daafd30194 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.220730 Jun 15 10:32:29.192741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 735/1355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:29.259979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:29.260596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:29.267745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:29.268217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:29.269036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:29.269477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:29.341171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:29.350506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22f958c4-eee5-49ea-9b38-65b86c8fa350 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094354 Jun 15 10:32:29.351107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 621/1356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:29 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:30.003512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:30.005265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:30.018729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.019511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.020876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.021688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.076442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e7e5f7c-5774-4e73-9210-46f6cd9a2124 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081059 Jun 15 10:32:30.078090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 736/1357] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:30.096141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:30.097285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:30.104694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.105197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.105997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.106434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.138562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:32:30.138893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:32:30.146751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-adcf811f-e3d1-4c56-aa9e-d1e4846defb9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054662 Jun 15 10:32:30.147746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 622/1358] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:30.218657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:30.219283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:30.226496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.227133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.228048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.228768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.370244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:30.371131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:30.377723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:30.379395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.380048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.381170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.381688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.389868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3bc6660e-d33e-4e06-a977-9473a91a1829 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174336 Jun 15 10:32:30.389868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 737/1359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:30.449501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:30.458416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6e90a04-25b4-45ea-9357-5ad28da102b0 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092600 Jun 15 10:32:30.459257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 623/1360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:31.091002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:31.091867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:31.099093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.099508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.100298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.100730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.135798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-869e5fbc-7467-4bf1-9b92-41b1de4de74e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048940 Jun 15 10:32:31.136508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 738/1361] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:31.160493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:31.161480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:31.168621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.169199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.170025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.171595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.208448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e75b6ea5-778d-43f0-938b-45fa136b6d23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052195 Jun 15 10:32:31.209385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 624/1362] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:31.407979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:31.408511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:31.415019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.415509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.416349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.416821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.476535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:31.477314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:31.485147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.485601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.486388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.486879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.565810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:31.580279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2d7f6674-a92b-4815-bdac-eb6bd84917f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.107518 Jun 15 10:32:31.581603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 625/1363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:31.611621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:31.620052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3139aa39-97e5-41c6-9c48-1524a921fa5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.216866 Jun 15 10:32:31.620626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 739/1364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:32.148092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:32.149081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:32.155343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.155804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.156584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.157043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.191100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-661a729e-cc7a-4fcb-b54c-92dc8b3e2b6a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046924 Jun 15 10:32:32.191886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 626/1365] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:32.222181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:32.223123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:32.231274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.238352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.238352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.238352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.268704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6dbcc64-52dd-42b5-99b0-8aeb7e04f935 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051433 Jun 15 10:32:32.269608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 740/1366] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:32.599474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:32.600102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:32.606574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.607020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.607967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.608553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.638349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:32.639632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:32.646205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.646797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.647696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.648195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.678286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:32.688667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bce8fad4-63d5-46e7-8ed9-522506282f68 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092676 Jun 15 10:32:32.689760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 627/1367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:32.808486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:32.817570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69e5bb39-a8a0-429e-a387-7e2eb11b3e40 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.183081 Jun 15 10:32:32.818139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 741/1368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:33.204061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:33.205025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:33.212036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.212484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.213296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.213729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.244613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-55d4aca9-4782-43ab-baaa-6db6a877cc66 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Jun 15 10:32:33.245206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 628/1369] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:33.281695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:33.282603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:33.289515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.289957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.290832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.291135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.321006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-22780cc3-7e87-4a2e-95d8-fe4e8e9a5e96 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 Jun 15 10:32:33.321553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 742/1370] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:33.712935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:33.713578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:33.721432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.721874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.722654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.723086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.791838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:33.800189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f8e2dc0-49ef-41ae-be97-1ee0143b4d4c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091528 Jun 15 10:32:33.800785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 629/1371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:33 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:33.836930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:33.837579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:33.844335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.844790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.845621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.846056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.996777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:34.006146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-750cf76c-e61b-42c5-be4b-2525eb196091 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173343 Jun 15 10:32:34.006729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 743/1372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:34.257884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:34.258897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:34.267172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.267619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.268448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.269132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.301853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21c8a2d9-585d-446b-852f-eb06e92c8df1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Jun 15 10:32:34.302449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 630/1373] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:34.334346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:34.335322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:34.342502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.342968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.343759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.344201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.378162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ac33cfd-ca43-41e9-bad5-814f15b92f79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048214 Jun 15 10:32:34.378754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 744/1374] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:34.817456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:34.818035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:34.824770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.825240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.826014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.826983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.895950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:34.904105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edf9bbb4-a8c6-42e2-8b61-274cc74f78fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090580 Jun 15 10:32:34.905309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 631/1375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:35.024676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.025325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.032083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.032564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.033395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.033834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.195872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:35.206406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc59e2dc-1657-4ec4-a2d9-592e47799c6b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185874 Jun 15 10:32:35.206993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 745/1376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:35.315436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.316582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.323945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.324391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.325219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.325659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.366553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7aeb6a77-7f3e-4a10-bf4c-376569fe7023 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056164 Jun 15 10:32:35.367340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 632/1377] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:35.391414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.392254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.399874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.400324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.401248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.401624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.434634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c91789e1-e9cb-4ad4-bca6-3e764c038a1a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048139 Jun 15 10:32:35.435231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 746/1378] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:35.921959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.922717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.929304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.929748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.930525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.930956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.014967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:36.024036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b6bbcd1-a848-4f90-b82a-15b9c897c0aa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105875 Jun 15 10:32:36.024647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 633/1379] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:36.224097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:36.224761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:36.231452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.231901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.233228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.233675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.378075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:36.381809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:36.383641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:36.387621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70e84b0d-1dd1-45a4-9c55-1a7d57ea0bad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.167436 Jun 15 10:32:36.388439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 747/1380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:36.390403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:36.397237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.400194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.400194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.400558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.437047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd09ebea-b497-4436-90cb-4a233f70073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062032 Jun 15 10:32:36.437641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 634/1381] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:36.447561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:36.448508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:36.456269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.456712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.457528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:36.457953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.493068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-169b7c18-a4bb-49bd-a391-140c934793bc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049486 Jun 15 10:32:36.493575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 748/1382] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:37.041864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:37.042510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:37.049214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.049661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.050444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.050880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.055619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:37.141461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:37.149667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-597ee328-7908-4442-9964-7309ba1f7093 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.111849 Jun 15 10:32:37.150269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 635/1383] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:37.407828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:37.408356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:37.415069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.415523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.416300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.416733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.449306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:37.450556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:37.463531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.464330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.465818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.466604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.500014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-740c7946-30ff-480f-986d-d689de616358 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054762 Jun 15 10:32:37.500596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 636/1384] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:37.505606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:37.506534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:37.512785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.513269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.514870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.515316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.555744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27e96457-527d-48f4-8aa7-6ccf25d9d74b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053989 Jun 15 10:32:37.557905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 637/1385] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:37.587065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:37.597143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7b4a185-f8b4-4453-b925-c9db3d16a76e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193493 Jun 15 10:32:37.597718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 749/1386] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:38.167577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:38.168328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:38.175939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.176387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.177363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.177807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.246904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:38.260897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db91edc1-c48d-424d-ac40-5e613d8cfce5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096868 Jun 15 10:32:38.261965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 638/1387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:38 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:38.512096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:38.513244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:38.520376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.520867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.521658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.522095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.558998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bbca9ae8-4705-42d7-be91-d167f7ff42ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051166 Jun 15 10:32:38.559583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 750/1388] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:38.569330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:38.570267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:38.577498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.577949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.578740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.579177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.612925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5253dc59-30e8-4769-9bbc-93befca92d00 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047578 Jun 15 10:32:38.613577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 639/1389] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:38.614972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:38.615767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:38.618698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:38.622563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.641040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.641040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.641040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.645278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:38.782130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:38.790671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8321f215-f520-4fb9-bbb2-bb1685714a7d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179627 Jun 15 10:32:38.791260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 751/1390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:39.281830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:39.282639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:39.289595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.290050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.290846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.291284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.370147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:39.385505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c6d54efa-5c33-4fd2-9653-cde3ccdc5020 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.109761 Jun 15 10:32:39.386557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 640/1391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:39.572391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:39.573363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:39.580387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.580826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.581623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.582051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.616286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-55bade7e-436e-42d4-b487-226412450b84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Jun 15 10:32:39.617191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 752/1392] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:39.624684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:39.625672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:39.632468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.632914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.633716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.634624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.669164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-303d2e11-b4af-4c1d-a3b1-a0083abf66c1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048520 Jun 15 10:32:39.669698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 641/1393] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:39.817640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:39.818184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:39.824597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.825075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.825857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.826552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.970287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:39.978410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf0614d9-9b2c-4663-9dd0-c14f41f42e88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.164667 Jun 15 10:32:39.978989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 753/1394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:40.406524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:40.407235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:40.414116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.414569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.415348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.415784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.482738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:40.491806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-119fd730-2447-47de-a189-6abbc4acdca9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090093 Jun 15 10:32:40.492465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 642/1395] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:40 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:40.628996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:40.629966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:40.637679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.638121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.639443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.640213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.675293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b379f7be-179e-4606-8f93-8d8fe685f3ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050409 Jun 15 10:32:40.675840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 754/1396] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:40.685000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:40.686662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:40.698530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.698986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.699774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.700217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.734942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7d4992a-c975-4f23-89b9-f19e2b187864 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054647 Jun 15 10:32:40.735540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 643/1397] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:40.996198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:40.996820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:41.004263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.004713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.005546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.005991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.160391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:41.168917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-79e0aec7-4967-4663-b143-1bf61e4e35e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176666 Jun 15 10:32:41.169613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 755/1398] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:41.514414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:41.515570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:41.525783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.527155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.527270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.528028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.604546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:41.613396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d0b2fdfb-889b-494d-921b-b4fb4397627c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105914 Jun 15 10:32:41.613965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 644/1399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:41 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:41.689308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:41.690254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:41.697381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.697832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.698610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.699048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.733118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f20c16e-1533-425e-a68c-36cd4f4d2d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Jun 15 10:32:41.733722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 756/1400] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:41.747776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:41.749567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:41.756667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.757339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.758118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:41.758542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.790508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-728c42cf-005a-4317-ad50-1601ab7fe4cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046727 Jun 15 10:32:41.790971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 645/1401] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:42.188010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:42.188683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:42.195581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.196024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.196900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.197366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.350717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:42.359012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0eda80c6-0328-484e-8732-ab97c9e3caa1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175480 Jun 15 10:32:42.359590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 757/1402] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:42.630677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:42.631290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:42.637914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.638358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.639853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.640332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.707666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:42.716435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e60b4dd-503f-4047-9587-433a5f2ca652 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089513 Jun 15 10:32:42.717119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 646/1403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:42 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:42.745707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:42.746935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:42.755366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.755809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.756606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.757173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.791524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed12bb3d-3aa0-43fd-b303-23bf66dbc5ec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050101 Jun 15 10:32:42.792038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 758/1404] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:42.802593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:42.803573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:42.811224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.812016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.812881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.813360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.848574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a306e549-ec5a-4a8d-8d02-334054798168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050352 Jun 15 10:32:42.849189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 647/1405] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:43.378455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:43.379073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:43.385894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.386418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.387265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.387765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.560466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:43.574030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35c7a1ed-e26d-4c99-a1d4-58f1897aa7f5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.199430 Jun 15 10:32:43.575031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 759/1406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:43.740147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:43.740833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:43.747488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.747932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.749521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.749962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.804346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:43.805346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:43.813497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.814113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.815153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.815724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.836208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:43.851754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ab7869be-9d66-4a95-b8fa-6ffb4ce75f72 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.114985 Jun 15 10:32:43.852291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1e7bf61-8ca9-4c06-ac66-53c074b4fee6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052349 Jun 15 10:32:43.852828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 648/1407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:43 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:43.853090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 760/1408] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:43.861729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:43.862843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:43.869563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.870011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.870803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.871236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.906802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98d8419f-05ce-4d39-9b36-75a29e4aaeac tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050412 Jun 15 10:32:43.907981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 761/1409] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:44.594647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.595263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:44.603860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.604422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.605304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.605755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.757091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:44.766159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-81bcb522-4cfa-443a-92f7-27f3d3c0e40d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175558 Jun 15 10:32:44.766742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 649/1410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:44.866983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.868413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:44.873480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.875248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:44.877772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.878224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.879009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.879990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.885559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.886425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.887806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.888556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.915359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ea9537dc-b3b1-4a5f-b90e-8b000f105f0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053457 Jun 15 10:32:44.916262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 762/1411] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:44.922358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.925257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:44.930489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.931380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.932442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.933260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.973814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-adb90f22-a0b5-4493-8f90-67f834f8b9a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055999 Jun 15 10:32:44.974872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 763/1412] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:44.997704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:45.003399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5763cd4b-17c0-4574-b835-602a1f73f04f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.136661 Jun 15 10:32:45.003975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 650/1413] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:45.784486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:45.785130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:45.792221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:45.792815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:45.793708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:45.794287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:45.935255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:45.938737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:45.947904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:45.948817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:45.949456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:45.952518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:45.961512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc030e09-6935-4cda-bd5a-794e293f3ebf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.180804 Jun 15 10:32:45.962101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 764/1414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:45.991927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:45.993099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:45.993564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:46.003740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f5b21f87-11d6-4611-a49f-7e2ded170111 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076109 Jun 15 10:32:46.008383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.008857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 651/1415] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:46.009051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.009051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.009051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.028337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:46.029305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:46.037500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.038068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.039259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.039986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.045622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc3a7415-f58b-486a-9a16-cb764076d649 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059696 Jun 15 10:32:46.046536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 765/1416] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:46.134137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:46.143096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78255ef2-1dba-4533-9b20-599109049798 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.119740 Jun 15 10:32:46.143684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 652/1417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:46.987307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:46.988064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:46.995312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.995758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.996551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.997018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.019030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:47.019983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:47.027516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.027965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.028921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.029484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.066162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-012276f4-346f-4113-8003-df469ce8e6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051194 Jun 15 10:32:47.066805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 653/1418] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:47.071808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:47.072748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:47.080435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.080929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.081728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.082170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.143182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f20ee5e3-c5e5-4125-b7cb-4e165c976225 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074907 Jun 15 10:32:47.144122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 654/1419] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:47.162673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:47.163333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:47.171263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.171721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.172582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.173192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.188114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:47.204698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-727e0092-f905-4fed-927b-365754d9bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.221070 Jun 15 10:32:47.205659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 766/1420] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:47.249647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:47.258428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99f00f6a-e542-400a-be62-544453c36313 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100196 Jun 15 10:32:47.259023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 655/1421] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:47 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:48.078298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.079237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.086737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.087183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.087964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.088397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.122582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab203e98-78fb-4248-a674-513e2c783d16 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048270 Jun 15 10:32:48.123296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 767/1422] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:48.157477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.158598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.166378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.166824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.167608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.168044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.204080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3bfc0f48-c67b-417c-990d-f026bfbcf206 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051574 Jun 15 10:32:48.204905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 656/1423] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:48.232018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.233331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.240185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.240760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.241713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.242438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.247837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:48.281054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.282352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.291245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.291696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.292493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.292925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.383489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:48.391976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90cf1a98-7616-4d7c-a72e-90407c2ce603 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.119488 Jun 15 10:32:48.392753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 657/1424] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:48.395895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:48.405816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-773b471d-1b74-4ad1-a108-60ef388e46e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177678 Jun 15 10:32:48.406503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 768/1425] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:49.136000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.137225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.145961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.146413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.147238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.147639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.189005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-897666b2-f235-4862-985a-9b4275ce8062 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057824 Jun 15 10:32:49.189694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 658/1426] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:49.216671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.218166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.225226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.225721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.226600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.227078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.274317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de82cb3a-37fb-4f76-8687-cf5ca9f1a5d9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061383 Jun 15 10:32:49.275424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 769/1427] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:49.410001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.410521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.417177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.417622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.418420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.418848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.423895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.424519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.431262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.431712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.432519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.432975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.487388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:49.495606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e769414-3421-4484-b289-805883013697 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089691 Jun 15 10:32:49.496423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 659/1428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:49.632692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:49.642108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c80ccd4f-ed40-41fe-896f-090ea0fe92cd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.222600 Jun 15 10:32:49.642696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 770/1429] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:50.202054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.203158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.210684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.211195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.211979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.212413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.249522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-54426866-9fac-4610-883b-84a7095a35e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052286 Jun 15 10:32:50.250193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 660/1430] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:50.287680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.288646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.296353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.296773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.297594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.298029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.332291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-783dfd7a-06bd-4643-9460-03bf27980fcc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048667 Jun 15 10:32:50.332888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 771/1431] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:50.512708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.513360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.520895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.521380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.522174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.522658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.596870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:50.605313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae206bbf-0a42-4f9d-aa05-1abadb60e756 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096600 Jun 15 10:32:50.605899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 661/1432] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:50.660662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.661318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.668084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.668536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.669362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.669844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.743654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:32:50.743975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:32:50.841797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:50.850225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1741339b-d556-4b8c-a80b-cc0556b4db8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193528 Jun 15 10:32:50.850815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 772/1433] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:51.262458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:51.263434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:51.271118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.271557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.272359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.272766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.306746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bdc43df6-ca02-4090-bf44-6370488b2b83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Jun 15 10:32:51.307328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 662/1434] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:51.345888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:51.346990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:51.355558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.356011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.356802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.357291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.394472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ace0017-48e4-4304-a439-cc2ac6e916e7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054375 Jun 15 10:32:51.395153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 773/1435] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:51.623393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:51.624120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:51.631398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.631839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.632613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.633171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.703813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:51.713025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76857b37-f749-4667-9f8e-64e663058d4f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094025 Jun 15 10:32:51.713614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 663/1436] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:51 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:51.871416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:51.872245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:51.879817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.880264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.881077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:51.881509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.023365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:52.037881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27b7aa28-c3bc-45e8-84b7-992a405c74b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173040 Jun 15 10:32:52.039130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 774/1437] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:52.319505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:52.320729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:52.328306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.328753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.329583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.330021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.365041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf80f3d1-2b06-4cbc-8ba4-7c5e2d1d9bec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049643 Jun 15 10:32:52.365627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 664/1438] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:52.409812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:52.410801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:52.420462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.420932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.421947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.422391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.456936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbcb189e-3443-4a29-a141-6bc6fc6b9537 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053351 Jun 15 10:32:52.458004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 775/1439] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:52.730407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:52.731020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:52.738300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.738749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.739530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.739960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.806503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:52.814746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05ccb54f-b586-4f90-869e-adcc7e81a537 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088075 Jun 15 10:32:52.815407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 665/1440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:52 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:53.066486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.067032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.074105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.074549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.075331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.075771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.254868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:53.263001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6df3ced6-24d6-451f-9a74-7b0f41afdf8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200704 Jun 15 10:32:53.264195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 776/1441] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:53.378279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.379191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.386508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.387008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.387824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.388368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.425445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa17a231-8d3c-4666-8407-bb0458d8e01c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052253 Jun 15 10:32:53.426028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 666/1442] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:53.470604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.471551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.478571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.479040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.479812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.480282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.518071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d013e8e3-9a4e-419b-acf1-73eba40041d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051863 Jun 15 10:32:53.518666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 777/1443] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:53.835215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.835835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.844348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.844786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.845600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.846036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.929387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:53.937942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-120ee126-40c5-4fee-8a5f-9b7dc561552c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.106830 Jun 15 10:32:53.938545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 667/1444] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:54.281733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.282359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.289366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.289811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.290605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.291043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.438057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.439357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.447359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.447807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.448604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.449080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.458467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:54.466426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-61884e58-1d2c-442d-ae5d-990d865558b0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188761 Jun 15 10:32:54.467747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 778/1445] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:54.470521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:54.487554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2dc006ae-807c-4abc-b096-6b226da660a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054087 Jun 15 10:32:54.488152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 668/1446] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:54.534930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.535834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.543392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.543842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.544824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.545216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.582942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2535d8bf-938a-44e7-9464-7adf33c618cb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054673 Jun 15 10:32:54.583533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 779/1447] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:54.958655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.959278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.966409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.966839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.967624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.968060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.040605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:55.056507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1d255b9-f6a0-4769-9ade-69a824c2c6b9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.101370 Jun 15 10:32:55.057605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 669/1448] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:55.485471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:55.486099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:55.492480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.492924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.493730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.494164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.501020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:55.502131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:55.511131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.511595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.512418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.512859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.548636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8318d77e-d34c-4186-93f5-8e8844a7980d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052432 Jun 15 10:32:55.549265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 670/1449] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:55.596149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:55.597216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:55.603728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.604181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.605003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.605455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.641735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b08a51b5-e917-4324-9496-76b9002df85c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049671 Jun 15 10:32:55.645637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 671/1450] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:55.646748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:55.655885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-06865124-3a3e-49b5-a123-a7f2c654a23d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174281 Jun 15 10:32:55.656567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 780/1451] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:56.076077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:56.076989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:56.083939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.084630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.085438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.085865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.151947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:56.160258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9de6d5d7-70ec-4982-bf7a-83ff92081e08 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088283 Jun 15 10:32:56.160826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 672/1452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:56 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:56.562245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:56.563324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:56.570515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.571732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.571732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.572266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.604943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ebeca083-de06-4ef1-8aaf-cf9a106e96e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048354 Jun 15 10:32:56.605540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 781/1453] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:56.654282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:56.655219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:56.662101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.662609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.663532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.663953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.678246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:56.679257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:56.691030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.691784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.693115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.693815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.718270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8874a11f-8e82-4d46-9ae2-04c77529a834 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067806 Jun 15 10:32:56.719235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 673/1454] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:56.904852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:56.919014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fd0fa006-ad65-43f6-a094-8835e1fdc8bc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.247417 Jun 15 10:32:56.920852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 782/1455] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:57.178486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.179329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.187155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.187603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.188397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.188872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.257489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:57.266012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ea7623b5-4ff8-495f-bb06-f63bb6875d9a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092313 Jun 15 10:32:57.266612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 674/1456] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:57.618311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.619317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.627276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.627724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.628514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.629043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.663719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b973479-7c58-4e51-90da-625f78a37738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049581 Jun 15 10:32:57.664303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 783/1457] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:57.731842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.733393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.740797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.741283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.742154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.742593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.776472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c882fcd3-ecc8-49c2-ac4e-feeb8c608532 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048918 Jun 15 10:32:57.777091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 675/1458] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:57.947940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.948642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.955842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.956297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.957115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.957554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.120371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:58.123974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:58.129230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4acb566d-29d2-455b-881d-128f68836544 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185188 Jun 15 10:32:58.130011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 784/1459] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:58.284201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:58.284903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:58.292096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.292595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.293887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.294369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.362661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:58.370838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9aaa3c5b-7c65-409b-a583-c4dce800e877 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090431 Jun 15 10:32:58.371345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 676/1460] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:58 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:58.677380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:58.678648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:58.687597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.688333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.689814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.690549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.729082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e129dd31-2c95-4357-bed5-1ea3a0631882 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056146 Jun 15 10:32:58.729731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 785/1461] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:58.793236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:58.795023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:58.806201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.806997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.808362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.809143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.856213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7dc7c725-0958-4b53-a794-9a773731b4aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070477 Jun 15 10:32:58.856820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 677/1462] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:32:59.147977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:59.148605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:59.157871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.158684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.160088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.160862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.342555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:59.351138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7480e24c-e8b1-474b-aae9-6b0e95f32e2f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.207068 Jun 15 10:32:59.351963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 786/1463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:59.391051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:59.391737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:59.398683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.399037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.399814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.400301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.474507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:59.482867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-57289dbb-bdb5-4086-b465-40af01c24116 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096407 Jun 15 10:32:59.483455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 678/1464] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:59 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:59.742265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:59.743891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:59.752079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.752525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.753351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.753791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.787665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9cce2ef1-1027-407e-a171-d88f63d8b0b5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050027 Jun 15 10:32:59.788253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 787/1465] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:59.867744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:59.868862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:59.876433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.876879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.877728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.878163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.911024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fca49928-6a63-4582-97df-a5f0639725af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047301 Jun 15 10:32:59.911613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 679/1466] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:32:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:00.369834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:00.370656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:00.378145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.378743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.379603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.380189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.510712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:00.511782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:00.528694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.528694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.528694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.528694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.532577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:00.543712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d704ca86-d940-4224-ba6e-e783171766ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177772 Jun 15 10:33:00.544942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 788/1467] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:00.610258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:00.618701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3375a7f0-77d6-4774-a462-bc38d026962b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.115116 Jun 15 10:33:00.619298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 680/1468] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:00 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:00.800672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:00.801721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:00.810219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.810219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.811164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.811731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.849408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4506726a-4535-40cc-8a5f-6b8bd41e778c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053603 Jun 15 10:33:00.850013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 789/1469] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:00.924085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:00.925127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:00.933596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.934376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.935579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.936341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.978738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fba0ea55-0924-40c4-85f5-b654303dddaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058964 Jun 15 10:33:00.979330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 681/1470] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:01.565164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:01.565845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:01.579879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.580351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.582278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.582726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.635797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:01.636420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:01.644768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.645236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.647209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.647653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.721922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:01.730770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6bb3d9c3-b538-40da-8e34-85e5b74745fd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098734 Jun 15 10:33:01.731361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 682/1471] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:01 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:01.774875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:01.783358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c9e476e-6bba-443a-b0f6-4e5eed433826 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.224666 Jun 15 10:33:01.783946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 790/1472] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:01.863268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:01.864130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:01.870401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.870832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.871614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:01.872052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:01.906397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4f53124-946d-413f-b9c0-b3ec0863bb7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Jun 15 10:33:01.906978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 683/1473] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:01.992341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:01.993301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.000759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.001225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.002007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.002425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.036280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-092ab24b-a731-4fd8-a1c4-4f7c59dbb9c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048685 Jun 15 10:33:02.036852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 791/1474] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:02.747665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:02.749173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.752942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:02.756591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.757068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.757844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.758273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.807897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:02.808439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.815396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.815842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.816623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.817082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.837333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:02.847583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd58dc35-5a93-4049-853a-242ae3eedeeb tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.103640 Jun 15 10:33:02.848179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 684/1475] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:02 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:02.919041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:02.921981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.928920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.929603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.930412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.930842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.936505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:02.967244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8ce87683-b94d-4b34-b5e3-6ed1a5f51786 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052263 Jun 15 10:33:02.967937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 685/1476] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:02.969164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:02.981911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a514c45b-2dcd-400e-b1b6-f3902f13080b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177942 Jun 15 10:33:02.983400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 792/1477] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:03.049113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:03.050051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:03.056944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.057435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.058272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.058656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.094416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1f7be3b-a576-489c-a6ef-65d6b051c77d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050114 Jun 15 10:33:03.095012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 686/1478] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:03.864985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:03.865644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:03.877682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.878131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.878938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.879373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.947540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:03.956349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd5c6c45-400f-4903-8950-570af12f3237 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095462 Jun 15 10:33:03.956890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 793/1479] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:03 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:03.978841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:03.979766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:03.987896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.988336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.989149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.989579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.009012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:04.009650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:04.016431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.016881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.017740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.018177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.023342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fe55c6d-204d-4b1a-9ed0-dc981359f724 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Jun 15 10:33:04.023925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 687/1480] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:04.106848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:04.108997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:04.115811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.116171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.117025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.117473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.151570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b84aef52-1f22-47e5-9939-7b451db6ebf8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048390 Jun 15 10:33:04.151570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 688/1481] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:04.181629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:04.190888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e7793361-210f-44c8-8682-421683d9d0dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185700 Jun 15 10:33:04.191481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 794/1482] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:04.974095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:04.974704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:04.981601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.982866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.983317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.983768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.037233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:05.038364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:05.047532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.048068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.049116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.049668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.059012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:05.072939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22619436-d23a-4344-b8bb-cfa3ff99f18a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.102533 Jun 15 10:33:05.073945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 689/1483] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:04 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:05.101531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d660857a-a3f5-4180-af74-a96c5d831e10 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069226 Jun 15 10:33:05.102227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 795/1484] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:05.164155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:05.165430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:05.172808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.173339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.174286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.174764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.208307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4fc168bb-69a1-4b3f-a358-05060b5ff2af tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048150 Jun 15 10:33:05.208890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 690/1485] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:05.211730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:05.212760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:05.222491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.222928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.223709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.224192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.371022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:05.379954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fcba90e0-9fe6-4340-8f61-c2a5fb511cd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175568 Jun 15 10:33:05.380540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 796/1486] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:06.098755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:06.099495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:06.107169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.108823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.109301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.109834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.116052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:06.117793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:06.128753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.129537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.130880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.131590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.179859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17d1cd8a-052c-4958-b385-182ca9e58541 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068812 Jun 15 10:33:06.180605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 797/1487] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:06.211554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:06.221973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6d042f4-136c-4eba-b541-af89cbee2628 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.127044 Jun 15 10:33:06.222566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 691/1488] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:06 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:06.226291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:06.227981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:06.240293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.241454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.242589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.243407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.303314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a666a04c-37d4-4711-b14e-234c70810e30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084850 Jun 15 10:33:06.304303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 798/1489] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:06.398691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:06.399263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:06.406877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.407374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.408205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.408671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.559935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:06.569536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-734a5411-d9fb-425f-91ac-20d1afbd163d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175018 Jun 15 10:33:06.570275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 692/1490] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:07.193428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:07.194834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:07.205394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.206076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.207336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.208014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.239841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:07.240492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:07.246280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d7a6085-7815-4c33-bf4f-37f9e05f2a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058082 Jun 15 10:33:07.246882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 799/1491] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:07.247330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.248347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.249435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.250090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.318298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:07.319422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:07.323099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:07.328021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.328541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.329499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.329998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.332168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1591bec5-c0e6-4b74-9925-aa1a8ad2c3f1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096237 Jun 15 10:33:07.332771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 693/1492] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:07 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:07.363839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e8c1374-1ce2-4c8e-8f75-fc9434923aa5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049807 Jun 15 10:33:07.364415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 800/1493] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:07.589173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:07.589809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:07.596456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.596905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.597733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:07.598186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.747152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:07.755514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c5aa054-3e07-40cf-a3e0-d6af9befee22 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170584 Jun 15 10:33:07.756206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 694/1494] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:08.260210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:08.261267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:08.265674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:08.269659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.270122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.270915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.271355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.290869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:08.306511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2a07ea2-8836-41c6-922f-3cabcb0b638c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050560 Jun 15 10:33:08.307092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 801/1495] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:08.350405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:08.351058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:08.359496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.359969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.360799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.361256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.379034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:08.379956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:08.387239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.387680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.389625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.390089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.425357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-904d493f-1200-4715-9efa-df2c1b786ac3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052172 Jun 15 10:33:08.426453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 802/1496] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:08.430971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:08.440099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a8cf20ed-4b3c-49fe-a04b-89cd9e11a46b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093804 Jun 15 10:33:08.440667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 695/1497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:08 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:08.774312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:08.774989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:08.781831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.782285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.783088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.783528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.955744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:08.964361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97511368-a32d-4c41-b300-c9df6c0f67d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.194078 Jun 15 10:33:08.964981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 803/1498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:09.318653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.319683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.327833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.328287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.329131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.329572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.364517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-802752b7-1a92-49d9-a7a2-313845dde117 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050045 Jun 15 10:33:09.365312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 696/1499] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:09.438909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.439855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.447022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.447474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.448303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.448744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.461736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.462837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.474768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.475564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.477081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.477888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.483183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3f3ecd6-83b4-4ff0-ab23-06523d51a013 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048356 Jun 15 10:33:09.483781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 804/1500] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:09.571350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:09.581084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-702766b2-fffe-4495-9d0d-d2e3ff0f6019 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.126737 Jun 15 10:33:09.581677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 697/1501] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:09.983335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.984100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.990833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.991279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.992077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.992514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.142197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:10.155743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-840df7c2-ca4e-4eb9-929f-21092caa07b4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176835 Jun 15 10:33:10.156777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 805/1502] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:10.378347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:10.379290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:10.386773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.387216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.388112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.390099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.426082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0dd08f49-7a24-4964-bc44-3a48946b9888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Jun 15 10:33:10.426662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 698/1503] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:10.495608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:10.496576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:10.504011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.504460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.505285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.505720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.539629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ea6001a-ef8b-40ad-a2c5-6b43d9e46ece tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048079 Jun 15 10:33:10.540467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 806/1504] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:10.599104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:10.599746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:10.606665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.607168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.607957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.608423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.679893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:10.689910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ec0eeb80-bf31-416e-b4db-fde61a7fceb3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094698 Jun 15 10:33:10.690503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 699/1505] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:10 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:11.174625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:11.175236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:11.181719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.182161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.182938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.183368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.333622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:11.343896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0fb6ef0f-92fa-4d1f-b666-ebffc8b111d5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173471 Jun 15 10:33:11.344491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 807/1506] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:11.438949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:11.439842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:11.447331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.447779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.448565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.449029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.485452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2d64a1d1-a278-4c45-9a01-9e356cadf646 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051373 Jun 15 10:33:11.486046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 700/1507] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:11.553857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:11.555116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:11.563529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.563982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.564767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.565247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.599555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f603ba77-b16c-4d40-bef8-b6fb1789c0c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050183 Jun 15 10:33:11.600150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 808/1508] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:11.708719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:11.709387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:11.716257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.717460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.718566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.719231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.786810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:11.793074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:11.803788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf558507-f63a-4ece-b67e-20f484b5ccbe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098556 Jun 15 10:33:11.804844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 701/1509] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:11 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:12.371295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:12.371921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:12.378544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.378985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.379767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.380188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.498792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:12.499756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:12.507162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.507603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.508367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.508803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.537693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:12.550445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-731e3013-354a-4316-b1a8-1aa417ad5f0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056560 Jun 15 10:33:12.551155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 702/1510] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:12.554900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7c2b899-8d28-4dbb-8d80-2b5992c071a9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.187464 Jun 15 10:33:12.555957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 809/1511] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:12.611255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:12.612193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:12.619039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.619485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.620261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.620707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.656561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38b836b4-aaf3-4c1b-ad03-8a92862f651d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049620 Jun 15 10:33:12.657372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 703/1512] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:12.900234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:12.900878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:12.909066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.909510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.910285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.910714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.979617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:12.987808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7be5f55-b740-4cb9-b166-286e809ab16a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091581 Jun 15 10:33:12.988399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 810/1513] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:12 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:13.562863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:13.563776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:13.572195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.572652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.573491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.573931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.574608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:13.575246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:13.582714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.583176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.584016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.584462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.611124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f2777b2-78f4-4630-9dbf-3bcfc8c02c2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052704 Jun 15 10:33:13.612035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 704/1514] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:13.671939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:13.673626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:13.682732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.683516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.684706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.686046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.724491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d1261567-16d2-44e6-9a88-372c90336910 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060008 Jun 15 10:33:13.725118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 705/1515] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:13.768571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:13.777012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a873454d-e994-4c5f-8e81-343c386e957f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.206395 Jun 15 10:33:13.777596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 811/1516] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:14.005532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:14.006237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:14.013799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.014350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.015163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.015594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.081528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.090039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c26318d4-f4c1-4301-8d46-40228f370126 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088701 Jun 15 10:33:14.090626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 706/1517] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:14 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:14.624555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:14.626516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:14.635230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.636033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.637493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.638612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.696408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4b9b9afa-074a-43be-85e3-5dcae381baa1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075329 Jun 15 10:33:14.697535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 812/1518] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:14.738992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:14.739921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:14.746383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.746835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.748247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.749352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.782521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ddc7862-0c2e-4d84-96d2-b868a8f1b8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047579 Jun 15 10:33:14.783100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 707/1519] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:14.796521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:14.797175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:14.803771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.804340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.805224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.805698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.977654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.986939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c78d0adc-6dcb-4add-8139-228d0dce5661 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.195085 Jun 15 10:33:14.987539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 813/1520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:15.115046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.115653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.122927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.123381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.124170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.124613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.191643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:15.199735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d434302-b6e7-4fec-8e82-6153b815f3af tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095700 Jun 15 10:33:15.200331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 708/1521] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:15.708735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.710165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.717223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.717667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.718444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.718874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.752707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ca3fb35-c945-4750-b38d-181bca6fe35a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Jun 15 10:33:15.753329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 814/1522] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:15.795517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.796473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.803444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.803885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.804661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.805130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.842043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-235159f1-9d25-484d-a6be-ab5336eeba10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050241 Jun 15 10:33:15.842656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 709/1523] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:16.003873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.004385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.010730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.011179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.011962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.012399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.159054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.167295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f931a672-e2c6-42fd-9b36-eb21e44cbc18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.167221 Jun 15 10:33:16.167881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 815/1524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:16.220703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.221343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.228753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.229232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.230040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.230479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.302095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.310449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-25a2da86-c49c-44e4-8d65-a05e4986f7b5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093965 Jun 15 10:33:16.312041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 710/1525] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:16 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:16.764637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.765356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.772575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.773054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.773968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.774425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.808882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a2fc84f0-6950-49df-aec7-ea8f9b827434 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Jun 15 10:33:16.809605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 816/1526] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:16.853929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.854956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.862127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.862572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.863341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.863777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.898214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f1691633-4686-4f14-8908-c5a9b3901821 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048433 Jun 15 10:33:16.898875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 711/1527] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:17.185564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.186426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.192628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.193115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.193886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.194317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.331560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.332358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.338434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:17.346040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.346811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.348231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.348493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d829bb0e-2c43-4244-93d6-35b8833526dc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.167119 Jun 15 10:33:17.349059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.349324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 817/1528] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:17.431821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:17.440231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c649c9d6-85c2-4bed-ad9e-a618857be0dd tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.114381 Jun 15 10:33:17.440828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 712/1529] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:17.822403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.823355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.833528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.833989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.835181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.835621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.839876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:17.871444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b733d21-a1cf-449e-af23-6fee44db66e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052699 Jun 15 10:33:17.873081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 818/1530] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:17.910849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.911819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.918304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.918746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.919569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.920309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.956699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eb22eff6-35ae-4abe-9e5b-505140e38ceb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050085 Jun 15 10:33:17.957305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 713/1531] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:18.368057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:18.368701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:18.376350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.376791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.377579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.378014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.458017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:18.458643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:18.466110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.466904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.467686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.468124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.523871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.535300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.538336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dadc323e-6ab5-4053-a97f-95e88f955398 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173132 Jun 15 10:33:18.539707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 819/1532] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:18.543520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38cfe23c-148a-4221-8284-1100624b48e6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089314 Jun 15 10:33:18.544086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 714/1533] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:18 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:18.884836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:18.885826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:18.893993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.894448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.895636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.896165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.929352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-95086e1b-764a-4a69-98f3-72f6076e6a5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048682 Jun 15 10:33:18.929939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 820/1534] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:18.969282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:18.970221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:18.976844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.977331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.978128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.978568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.011915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b85816d-08f9-4015-b055-b7c4fad6eaaa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046760 Jun 15 10:33:19.012389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 715/1535] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:19.561883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:19.562615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:19.566105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:19.567266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:19.569775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.570329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.571223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.571809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.582018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.582474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.583304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.583747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.662694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:19.673033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d89a7077-90e6-4a63-a36b-b00e8e1df0ce tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.114936 Jun 15 10:33:19.673628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 716/1536] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:19 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:19.733602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:19.741871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-580fd1d0-2837-4517-bbb7-1d83f61c0a46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185432 Jun 15 10:33:19.742518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 821/1537] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:19.941343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:19.942185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:19.948637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.949114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.949898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.950332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.985636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16564090-ebb6-4ffa-aa9c-68ddadebcaa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Jun 15 10:33:19.986740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 717/1538] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:20.024060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:20.025163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:20.032427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.032914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.033750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.034189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.067499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69b33d5a-4a3f-45e8-a3ca-eb55976980ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047670 Jun 15 10:33:20.068077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 822/1539] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:20.695953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:20.696565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:20.705499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.705946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.706741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.707174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.727880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:20.763893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:20.764838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:20.774012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.774766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.775416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.775931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.776985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.785321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88feca3c-bf3a-4e29-b101-686958a5b386 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093209 Jun 15 10:33:20.785910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 718/1540] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:20 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:20.963036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.972209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a53023e8-1536-460a-ace4-f432069a42e4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.214389 Jun 15 10:33:20.972937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 823/1541] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:20.998728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:20.999996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.006844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.007345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.008253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.008763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.044580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7b74e270-88eb-4ce4-b923-64b51f488fcd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050275 Jun 15 10:33:21.045368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 719/1542] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:21.081099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:21.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.089522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.089993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.090747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.091258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.129881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e77fd38-9e50-4e6c-923e-bc6bf6cfe312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054010 Jun 15 10:33:21.130549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 824/1543] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:21.806012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:21.807187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.818562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.819358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.820892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.821802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.890259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:21.898672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-622259e4-6b56-4bfe-80ee-530d495c36bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100144 Jun 15 10:33:21.899283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 720/1544] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:21 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:21.990515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:21.991136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.999545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.999984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.000765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.001223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.056646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:22.057778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:22.065953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.066660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.067617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.068218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.101709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af6cc5ab-e21a-40a1-8515-96b20c8d7891 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049300 Jun 15 10:33:22.102303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 721/1545] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:22.144072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:22.145050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:22.160629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.160629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.161090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:22.161868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.161868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.164329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21517577-5895-490e-80ff-19c720a915cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177459 Jun 15 10:33:22.165074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 825/1546] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:22.192130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d2f01ed-74f6-46db-9a4e-939d32a20c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053946 Jun 15 10:33:22.192725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 722/1547] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:22.916493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:22.917028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:22.923823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.924268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.925075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.925528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.115294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:23.116381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:23.124839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.125315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.126199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.126642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.165839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e45c098-86b6-47b7-beb0-b0d7d61c2edb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054699 Jun 15 10:33:23.167052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 723/1548] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:23.187405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:23.188569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:23.199910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.201493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.202686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.203467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.258345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:23.267070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-90b75165-90fd-4876-893d-d119c4f89ccc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.354841 Jun 15 10:33:23.267664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 826/1549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:22 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:23.272673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:23.273653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:23.281803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.282463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.283445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.284046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.329712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8825e4c9-5f49-4465-9759-5477e0875c5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060488 Jun 15 10:33:23.330790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 827/1550] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:23.387494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:23.397174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-381e8f44-f737-4cb4-a4b9-7fd73074e0e0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.215047 Jun 15 10:33:23.397771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 724/1551] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:24.181429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:24.183617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:24.198274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.199043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.199992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.201186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.236506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-879affd6-b94c-4493-aef4-12bdef9af6cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060452 Jun 15 10:33:24.237124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 828/1552] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:24.291045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:24.291668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:24.298916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.299367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.300187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.300629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.346919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:24.346919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:24.357780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.358576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.360048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.360845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.382356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.395510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af15a422-5f01-46fc-9736-3d5a8f4a4a4a tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.108122 Jun 15 10:33:24.396475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 725/1553] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:24 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:24.408330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e40615cc-e125-45c4-b833-c3bd54707a79 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067980 Jun 15 10:33:24.408927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 829/1554] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:24.419837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:24.420551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:24.427463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.427910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.428710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.429185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.583148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.592509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d7772d5-d9e9-4f26-97ee-4ea70a52714b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176776 Jun 15 10:33:24.593341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 726/1555] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:25.250449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.251537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.259339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.259789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.260573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.261040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.297359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-acaa9833-8539-49a4-bde0-16020d524983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052407 Jun 15 10:33:25.298265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 830/1556] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:25.416081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.416813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.420855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.421844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.424521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.425004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.426104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.426536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.428741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.429368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.430176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.430612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.468836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8582706-9161-446d-8be9-528a5b68dd8b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052208 Jun 15 10:33:25.469765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 831/1557] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:25.496408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.506724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4cfca646-bca3-4ddc-8016-c4cfd11ea438 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095117 Jun 15 10:33:25.507586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 727/1558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:25.611900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.612845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.620298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.620805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.621705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.622894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.779987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.789990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3954c8d0-9ab4-43a3-b95d-ac7b838cd6a0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.183089 Jun 15 10:33:25.790584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 832/1559] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:26.310035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.311063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.317631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.318070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.318841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.319264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.353096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-009f19a7-73a5-408a-b7f9-f4078d807183 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Jun 15 10:33:26.353669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 728/1560] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:26.484576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.485615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.492815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.493338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.494156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.494623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.528110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.529072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.534892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4f0a5a64-8b25-4a9a-bc6d-3d4c5fb87165 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054972 Jun 15 10:33:26.535665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 833/1561] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:26.539879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.540441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.541339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.541776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.614051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:26.628549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d1e44e01-54c5-4ff5-a865-23156045b3f9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105009 Jun 15 10:33:26.629638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 729/1562] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:26.816401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.817068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.823534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.823978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.824763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.825246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.972085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:26.977141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:26.984402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6da55e8b-4131-4bbd-bd88-c22efe7b5e23 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.172016 Jun 15 10:33:26.987529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 834/1563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:27.367097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:27.368023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:27.374483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.374920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.375697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.376131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.411681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-40fb6af4-4fa9-4e01-9d71-bce3177bb364 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Jun 15 10:33:27.412258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 730/1564] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:27.549404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:27.550356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:27.557264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.557719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.558520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.558961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.593607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-93fbdc03-e420-41b9-9435-16d699332a06 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049646 Jun 15 10:33:27.594196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 835/1565] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:27.647107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:27.647685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:27.654691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.655132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.655898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.656327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.725575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:27.734370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d07fdf9d-efde-4f67-816f-1c6cf8f8d110 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091238 Jun 15 10:33:27.734951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 731/1566] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:27 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:28.004152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:28.004766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:28.011197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.011658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.012428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.012978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.181720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.190966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de94f5ac-8258-42a8-bbb7-4492571766da tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190971 Jun 15 10:33:28.191561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 836/1567] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:28.424101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:28.424944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:28.431780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.432221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.433083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.433527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.469598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c80b539-eb81-42d4-b49e-0fba29e1cf29 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049719 Jun 15 10:33:28.470165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 732/1568] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:28.605918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:28.607050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:28.614358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.614807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.615602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.616044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.649664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8256d67a-5167-4c03-a333-50343a3df031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047936 Jun 15 10:33:28.650274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 837/1569] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:28.759129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:28.759750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:28.767703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.768195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.769081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.769561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.837631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.846906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ebcad0f3-69bd-4c7f-a2fb-a545c868b3a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091722 Jun 15 10:33:28.847493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 733/1570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:28 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:29.215229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.216096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.223388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.223834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.224628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.225124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.409478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:29.417575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56190201-aceb-4987-8bf8-abba16e0027a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.206857 Jun 15 10:33:29.418148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 838/1571] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:29.482153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.483095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.486225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:29.489886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.490334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.491119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.491574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.523329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-58f3d92c-655e-4252-851d-9f06a7ee3c45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Jun 15 10:33:29.523923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 734/1572] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:29.626293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:33:29.626578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:33:29.662131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.663098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.670411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.670876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.671681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.672128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.705057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a1385c5-b2aa-4c7c-9e7e-5357b272d752 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046926 Jun 15 10:33:29.705526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 839/1573] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:29.864197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.864765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.872751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.873473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.874272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.874709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.879418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:29.942251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:29.952503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d915e8e-00aa-46c4-bc74-1c97b7a43450 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092082 Jun 15 10:33:29.953242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 735/1574] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:30.436290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:30.436930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:30.443313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.443892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.444735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.445204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.541565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:30.542545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:30.549391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.549842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.551092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.551930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.592645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-94a5193f-9409-496c-8c42-3ddd93b4363b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059703 Jun 15 10:33:30.596877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 736/1575] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:30.598386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:30.606399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e7294606-8c80-4df6-8bca-30e139616d98 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174050 Jun 15 10:33:30.607293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 840/1576] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:30.716692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:30.717659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:30.724662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.725202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.725940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.726383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.759805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae40c31e-d82e-4464-b260-c61a4b9e0c8e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047256 Jun 15 10:33:30.760477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 737/1577] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:30.971142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:30.972033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:30.979069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.979561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.980390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:30.980861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.049132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.057397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d618853-582c-4641-826b-58a93c1cf5f4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090863 Jun 15 10:33:31.057977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 841/1578] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:31.604281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:31.606657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:31.612476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.612920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.613777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.614209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.624271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:31.624890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:31.631510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.632163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.633255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.633795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.655347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b6d70d1-0519-45f5-a574-2e5c5d127503 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055132 Jun 15 10:33:31.660783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 738/1579] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:31.772814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:31.773847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:31.781020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.781460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.782311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.782998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.786998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.797088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c9507db-aa34-46dd-97e3-7672ec018be2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176989 Jun 15 10:33:31.797639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 842/1580] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:31.833128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9c9a4126-d08f-4405-b53f-efb6d81257e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064771 Jun 15 10:33:31.834156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 739/1581] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:32.075258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.076126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.085376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.085911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.086696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.087158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.156139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:32.164283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0a5ebf6-801b-40fe-ba98-4267a14b5533 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093032 Jun 15 10:33:32.164901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 843/1582] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:32.668858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.670462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.677437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.677891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.678678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.679118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.713596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16521457-c9be-4412-889d-c94b5b976264 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048734 Jun 15 10:33:32.714177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 740/1583] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:32.820805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.821346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.829778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.830388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.831589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.832252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.847164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.848082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.854759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.855208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.856008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.856442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.895647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7fd2e760-0363-49f8-8907-ea60a0f922f5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052459 Jun 15 10:33:32.896457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 741/1584] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:32.996989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:33.006046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bea153b8-3937-473b-a3d9-8abf48678e03 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.189082 Jun 15 10:33:33.006638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 844/1585] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:33.181659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:33.182188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:33.189583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.190239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.191150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.191685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.273069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:33.281941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da40a5cc-a4fb-4bb8-95ad-b83a4fc58da9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.104427 Jun 15 10:33:33.282739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 742/1586] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:33 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:33.726567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:33.727508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:33.735098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.735548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.736340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.736780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.770872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ca31da6-eaff-43fd-aa5a-4ffe5028621f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048357 Jun 15 10:33:33.771552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 845/1587] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:33.910303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:33.911134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:33.918221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.918669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.919952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.920372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.954275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6bdae33-5f5b-4d72-a20a-980261830e9b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047968 Jun 15 10:33:33.954952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 743/1588] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:34.024384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.025054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.031676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.032128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.032946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.033419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.194569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.209219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3049a4a3-aa11-49ae-a7ee-52c043461cfa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188377 Jun 15 10:33:34.210579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 846/1589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:34.299701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.300308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.307118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.307556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.308329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.308758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.378788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.388723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84e423d0-5c38-4e98-b62e-cffd64b26523 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092535 Jun 15 10:33:34.389350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 744/1590] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:34.784809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.785774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.792851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.793245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.794075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.795111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.829551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2359035-3237-478d-b96b-cccf357351c7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Jun 15 10:33:34.830138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 847/1591] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:34.967590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.968514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.975928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.976378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.977198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.977630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.011837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-888c0686-7b7b-4e8a-86f7-6f1d1dd8849d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048980 Jun 15 10:33:35.012419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 745/1592] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:35.237780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:35.238446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:35.245689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.246128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.246911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.247887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.404944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.406943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:35.407565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:35.414665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.415117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.415917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.416405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.420256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d57626ba-851a-40c4-b107-898fb8bee854 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186236 Jun 15 10:33:35.421654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 848/1593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:35.495057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.505290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0bb574d7-a71b-4efb-8c89-6269bfeab68c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.102432 Jun 15 10:33:35.506167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 746/1594] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:35.842393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:35.843249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:35.850278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.850725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.851510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.851935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.886113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77aef8f6-3590-4328-82b3-e6bbb5e2fab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048275 Jun 15 10:33:35.886773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 849/1595] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:36.030426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.032186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.045111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.045953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.047273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.048049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.088183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-608dfd97-216b-484e-879b-51a3a9effcb0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066020 Jun 15 10:33:36.088838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 747/1596] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:36.441343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.441958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.448698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.449182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.449968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.450968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.523915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.525754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.535961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.537203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.538791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.539587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.616790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.625988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b449bf4-4703-4b23-b447-0f0de8aba487 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.188585 Jun 15 10:33:36.626578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 850/1597] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:36.633809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.643422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c2af9f3-3f25-4fbf-ae46-5053c97874a5 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.124000 Jun 15 10:33:36.644407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 748/1598] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:36.899290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.900269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.904341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:36.908146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.914358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.914358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.914358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.929275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:36.945750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1d5f0ee-a8a5-43d9-9561-e93ee96fbddc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050512 Jun 15 10:33:36.946322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 851/1599] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:37.100496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.101904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.110034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.110472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.111266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.111724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.146315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-679a91e0-adc5-47df-b5b0-b1f7f2895f09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050205 Jun 15 10:33:37.146904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 749/1600] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:37.661286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.661904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.669410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.669866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.670658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.671085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.703893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.705073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.715632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.716174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.717245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.717812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.742093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.750776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb796234-395e-491d-bd83-af84d2dc8fde tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093689 Jun 15 10:33:37.751360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 852/1601] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:37.869441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.877641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a41d5ea6-e91a-4898-971b-179e2d6faf82 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.178856 Jun 15 10:33:37.878235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 750/1602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:37.959515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.960710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.968192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.968637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.969451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.969884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.003567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0439197-2b1f-4758-8695-da2aff276102 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Jun 15 10:33:38.004381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 853/1603] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:38.161412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:38.162268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:38.170128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.170763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.171556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.171987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.200207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:38.205090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ca6478e-32c8-48f0-bc94-45b5ee49c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047898 Jun 15 10:33:38.205669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 751/1604] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:38.770335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:38.771113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:38.778062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.778535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.779428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.779862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.848465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:38.857342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-543033ba-20a0-4ccf-9d00-61e92e17b0c7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090838 Jun 15 10:33:38.858003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 854/1605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:38 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:38.896167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:38.896831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:38.905219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.905795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.906731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.907282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.021360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:39.022596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:39.033915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.034722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.036215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.037072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.084037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c46393b-3fac-4eec-98da-69ae08eb7738 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067982 Jun 15 10:33:39.088649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 855/1606] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:39.089949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.098578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ef5f23e5-c2b8-4974-8f14-9a10aa78c188 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.206317 Jun 15 10:33:39.099072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 752/1607] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:39.219497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:39.220477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:39.227419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.228023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.228811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.229281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.269845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed44817c-ad07-4b74-bdbf-24598b47db44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055540 Jun 15 10:33:39.270591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 856/1608] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:39.876000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:39.876617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:39.885211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.885657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.886452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.886888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.959135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.967877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c5806169-aab4-47bb-93fc-2a44657c5a8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096695 Jun 15 10:33:39.968464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 753/1609] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:40.097260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.098581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.106819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.108073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.108987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.109567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.121686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.123248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.134495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.135123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.136488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.137265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.159345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-95c29605-28d4-4efb-9485-1ccc29b6451c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066171 Jun 15 10:33:40.160132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 857/1610] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:40.284282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.285562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.292420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.292867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.293715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.294703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.320704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.331465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d252e5d-03a3-41de-bd5e-f75a7d9c4545 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052743 Jun 15 10:33:40.331699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4ade8e8-b96e-4000-864b-6495750823c5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.216465 Jun 15 10:33:40.332266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 858/1611] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:40.332384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 754/1612] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:40.985463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.986070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.992585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.993051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.993835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.994274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.063997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.072217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b038b8f-dbdb-4a1d-a14d-e657243f9e1d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091179 Jun 15 10:33:41.072811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 859/1613] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:41.173480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.174451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.181786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.182263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.183050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.183483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.219637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a541c169-6dc9-43be-be24-3ae6138c7ce0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050340 Jun 15 10:33:41.220297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 755/1614] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:41.344335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.345256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.352689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.353197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.353975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.354149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.354427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.355099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.365886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.366627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.367978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.368681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.389230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c8f2413-9634-4d41-a437-5620d2498228 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049156 Jun 15 10:33:41.390152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 860/1615] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:41.538121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.547765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-749d6914-0ac9-49ac-b793-4d3104056669 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.200444 Jun 15 10:33:41.554355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 756/1616] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:42.090372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.091002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.097891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.098340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.099138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.099579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.175060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:42.183863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6f68546-09fc-40f0-86d4-6994812d2939 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097368 Jun 15 10:33:42.184517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 861/1617] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:42.232993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.234011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.241994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.242441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.243245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.243692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.281332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cfb35627-4212-446a-9c37-7cec2ec18ee2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052798 Jun 15 10:33:42.282281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 757/1618] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:42.402553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.403470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.411375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.412285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.412615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.413054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.448780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6ad2833-1934-456b-a356-709cd2f6bbdf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050446 Jun 15 10:33:42.449501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 862/1619] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:42.566367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.567019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.573968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.574415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.575247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.575688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.739605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:42.747674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fc86376-60e5-4816-ae95-4cf7c95b1849 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185286 Jun 15 10:33:42.748308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 758/1620] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:43.202376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.203007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.209687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.210392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.211191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.211630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.281488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.291218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0eba3141-5f76-4eb9-968c-ca561e09c00b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093645 Jun 15 10:33:43.291806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 863/1621] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:43.294838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.295755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.302865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.303307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.304301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.304730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.337657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee80ee53-7c73-4c89-987e-1ed29f26e421 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Jun 15 10:33:43.338234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 759/1622] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:43.462341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.463550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.471933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.472374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.473226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.474708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.508261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e336d8f-32c2-4d3e-88dc-a3ce93c2d044 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050371 Jun 15 10:33:43.508932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 864/1623] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:43.766029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.766555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.772737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.773214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.773980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.774413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.922423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.931610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ac414c0-e00c-47ee-8fd7-ca581817e27f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170028 Jun 15 10:33:43.932338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 760/1624] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:44.316163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.316834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.323816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.324260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.325095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.325775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.350208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.351176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.359546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.360106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.361006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.361607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.419248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-189023ca-7569-4c61-adb0-47c489f1fff7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072394 Jun 15 10:33:44.421150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 761/1625] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:44.421536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.430421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-30e13054-0b6b-4a04-a4e1-1f25179ad651 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.118379 Jun 15 10:33:44.431012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 865/1626] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:44.521378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.522631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.532121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.532852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.534582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.535394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.574241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0c7102c-5ebd-4193-a3ed-080ce04b79c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057839 Jun 15 10:33:44.574866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 762/1627] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:44.700618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.701623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.709127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.709792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.710878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.711589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.950926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.951560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.958648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.959104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.960539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.961001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.112772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:45.121763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa1238e9-76f9-4969-aa08-71f42d055d5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175865 Jun 15 10:33:45.123047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 763/1628] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:45.433655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.435189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.442567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.443028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.443825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.444285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.479841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dbfaee5f-7f88-4a3a-a465-f5c1cc3e3f4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050221 Jun 15 10:33:45.480613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 764/1629] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:45.485408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.486101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.493077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.493523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.494301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.494734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.569495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:45.578766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93c220b4-ff6e-4ee3-a3ce-f08f2449ac86 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096995 Jun 15 10:33:45.579417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 765/1630] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:45.589561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.590975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.598231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.598671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.599461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.599892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.636622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bdbc341d-d65e-43d0-834a-d8c244a6f8bd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051600 Jun 15 10:33:45.637256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 766/1631] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:33:46.140399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.141075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.148174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.148603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.149426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.149867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.318035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.327211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f7b85c9b-0365-4031-b35d-006cdad5165b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190917 Jun 15 10:33:46.327799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 767/1632] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:46.494047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.495008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.502683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.503125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.503909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.504347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.523655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:46.538934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90c8d727-1cb4-48b2-8cf6-82c8668743d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049209 Jun 15 10:33:46.539532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 768/1633] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:46.601768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.602802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.614575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.615394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.616749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.617887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.711489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.720126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78e63352-7bbe-470d-b5a9-38b0320f0769 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.125981 Jun 15 10:33:46.720727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 769/1634] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:46.725845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.726907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.734468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.734917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.735703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.736133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.788638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f116f50-2413-416a-98fe-d2652294fabe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066407 Jun 15 10:33:46.789681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 770/1635] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:47.346114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.346984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.354376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.354821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.355621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.356060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.512289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.521722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3213227d-17eb-4ddd-900d-8a0e9923d8e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179868 Jun 15 10:33:47.522432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 771/1636] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:47.554244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.555760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.567509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.568244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.569627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.570373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.609952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51b5eafd-0d80-42f1-85ec-51d3f60d9be4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062674 Jun 15 10:33:47.610631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 772/1637] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:47.747352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.748077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.755251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.755745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.756565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.757079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.837732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.846603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43fb73aa-0d5d-44d7-9b60-a0857eb806a6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.105371 Jun 15 10:33:47.847262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 773/1638] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:47.857038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.858717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.867573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.868069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.868887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.869422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.916446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-587e5aa1-15b5-4931-8d17-8479fc20bed3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067343 Jun 15 10:33:47.917561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 774/1639] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:48.542114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.543212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.551605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.552046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.552821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.553287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.704171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.714942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-687e19e9-c021-452b-a6b3-99f2d2860dee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177670 Jun 15 10:33:48.716157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 775/1640] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:48.721724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.722809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.730609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.731175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.732562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.733223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.782211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-54edf62c-ccd9-481f-8349-aef5747075ea tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064873 Jun 15 10:33:48.782808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 776/1641] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:48.871872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.872559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.879439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.879925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.880836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.881539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.954692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.963432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c74d940b-cff3-4ba3-8513-753b232eb1ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095636 Jun 15 10:33:48.964030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 777/1642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:48.969905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.970855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.978717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.979312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.980319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.981064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.016921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c35fd6f5-32d3-4879-b969-56e1059befde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051661 Jun 15 10:33:49.017548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 778/1643] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:49.735862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.736602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.744343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.744787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.745625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.746064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.894621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.902855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-653714a8-fbe3-4883-be93-d781df9635f6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.171386 Jun 15 10:33:49.904033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 779/1644] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:49.908831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.910078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.916759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.917310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.918089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.918523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.949773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-08286651-b5a1-4722-a6ea-e7e1e711e513 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Jun 15 10:33:49.951066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 780/1645] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:49.981950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.982561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.989028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.989688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.990505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.990938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.056362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:50.066095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcd6b557-5d97-4902-9628-625a47460642 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088149 Jun 15 10:33:50.066721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 781/1646] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:50.072171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:50.073279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:50.081018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.081466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.082307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.082744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.117392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-461ea974-19dc-4795-b3e6-9d836b6fa77b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049422 Jun 15 10:33:50.117941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 782/1647] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:50.921994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:50.922670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:50.929929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.930376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.931228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.931728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.094781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.103740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3a710993-3b21-4cab-bdaa-92d050d2f907 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186483 Jun 15 10:33:51.104342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 783/1648] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:51.110530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.111594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.114870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:51.119382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.123132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.123132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.123132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.171218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c55b9144-6dda-43e1-a6ed-714f79b22866 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065474 Jun 15 10:33:51.172148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 784/1649] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:51.180820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.182037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.193556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.194337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.195721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.196502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.205119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:51.288985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.297496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b51b1a56-65f6-4444-92ae-b43b07369011 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.123790 Jun 15 10:33:51.298098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 785/1650] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:51.302970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.303889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.311291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.311750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.312529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.312994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.347102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5accb415-fe19-4565-8c6f-0e2b5e771ba6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047904 Jun 15 10:33:51.347829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 786/1651] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:52.082413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:33:52.083051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:33:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:33:52.124260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.124885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.132351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.132775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.133736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.134171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.286066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.294588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3916b6ae-3310-45f3-bcf4-59782c5c319c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174551 Jun 15 10:33:52.295244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 787/1652] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:52.300293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.301267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.308098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.308574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.312384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.312384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.346645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-34d5de63-9ac4-43f6-b425-fa5353e0c410 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048776 Jun 15 10:33:52.346645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 788/1653] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:52.350862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.351473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.358215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.358792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.359660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.360106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.456682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.467982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f58fe8a-6fb2-4f1b-bf53-542ac6b18f2e tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.120713 Jun 15 10:33:52.468767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 789/1654] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:52.478105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.479774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.489362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.489868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.490791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.491286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.526560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7e651f7d-86e7-46d2-a1e7-555a9902da31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056148 Jun 15 10:33:52.527349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 790/1655] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:53.322218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.322941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.330091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.330534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.331309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.331736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.499063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:53.509167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-441cc84f-e62c-402d-b062-b844b8be5a9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190658 Jun 15 10:33:53.509891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 791/1656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:53.516568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.517653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.525441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.526053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.526996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.527596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.566361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e609b647-ab81-43c7-b99e-49a1f7bb1430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055078 Jun 15 10:33:53.566968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 792/1657] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:53.571938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.572567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.579880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.580324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.581507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.581948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.655692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:53.665238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d9c6fb7a-786c-4620-9195-7c574381cfaa tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097099 Jun 15 10:33:53.666241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 793/1658] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:53.672296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.673258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.681118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.681565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.682348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.682775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.722656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7de87740-05cd-4670-bf10-e7d5a5e2f66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055229 Jun 15 10:33:53.723248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 794/1659] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:54.527082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.527824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.536599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.537276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.537968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.538423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.689498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.701339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f642c87-32b6-4043-965a-230bffb4fb8a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.178193 Jun 15 10:33:54.702034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 795/1660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:54.708294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=30 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:54.735538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=90 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:54.821892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.822875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.837183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.837627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.838394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.838816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.878656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a6bbecb-890f-4f14-9173-3f5db2826785 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175357 Jun 15 10:33:54.879510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 796/1661] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:54.886909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.892579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.895771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.896207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.896998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.897425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.964390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.973495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5163c1d2-81f8-433c-aa0a-3f030bf3f261 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.092724 Jun 15 10:33:54.974077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 797/1662] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:54.979237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.980150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.986838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.987205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.987982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.988421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.020937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a5224df-247e-45b1-a791-9dfd9ba739f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045639 Jun 15 10:33:55.021538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 798/1663] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:55.721038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.722109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.729369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.729934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.730799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.731673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.876182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.884769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-722f7cf5-c44e-45c6-b76d-f61381c28f10 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.168128 Jun 15 10:33:55.885403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 799/1664] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:55.896190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.897932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.910123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.910924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.912378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.913216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.974743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28f4fe88-f228-47cc-b602-369de1690c9e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085773 Jun 15 10:33:55.975782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 800/1665] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:55.991432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.992166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.999797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.000321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.001212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.001689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.073595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:56.078004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:56.082773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-319f05b1-27a8-42a3-a903-a88684f8bd37 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095485 Jun 15 10:33:56.083365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 801/1666] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:56.088569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:56.091195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:56.099171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.099844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.101075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.101743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.140864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-379b6d9e-659c-482d-a107-08f1893487d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056363 Jun 15 10:33:56.141471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 802/1667] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:56.904811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:56.905774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:56.912738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.913270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.914054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.914487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.078099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.088772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a40d1b2d-ff42-46c7-898a-822ded7b2a43 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.189076 Jun 15 10:33:57.094475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 803/1668] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:57.095934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:57.096859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.103774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.104218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.105032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.105473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.142546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2478d180-c813-4d84-ab63-dfafe75f5601 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050681 Jun 15 10:33:57.143041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 804/1669] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:57.148218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:57.148868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.155880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.156323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.157139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.157576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.225803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.239544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c08597a1-87be-4722-a738-ffe97e89bda8 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095341 Jun 15 10:33:57.240138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 805/1670] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:57 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:57.245319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:57.246367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.254369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.254819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.255598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.256029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.292930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c86c6449-3a38-4a8a-ae34-c5b759c27476 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051628 Jun 15 10:33:57.294118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 806/1671] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:58.107818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.108582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.116120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.116562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.117382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.117812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.270083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.279603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29f768e6-a4d3-456f-87cf-2071d43160e8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176008 Jun 15 10:33:58.280205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 807/1672] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:58.285277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.286211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.292782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.293257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.294782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.295217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.329147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-728380e3-0cab-4a4b-81a2-9142521ad097 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047768 Jun 15 10:33:58.329737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 808/1673] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:58.334873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.335734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.343270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.343759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.344576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.345169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.413388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.422602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10c1d54d-9c24-4d75-9935-e351a811ebf3 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091714 Jun 15 10:33:58.423274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 809/1674] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:58.432393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.434618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.444377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.444867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.445724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.446209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.481038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be3789e8-2a34-4c27-a155-590fed0b20c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056191 Jun 15 10:33:58.481781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 810/1675] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:59.306045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.306829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.316682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.317372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.318270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.318815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.475688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.487483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9a14cf0-341e-4f55-829f-e8d2e63fb039 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185783 Jun 15 10:33:59.488077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 811/1676] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:59.493252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.494196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.503144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.503759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.504638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.505188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.540628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3dcd2eb5-9dc0-49ed-9698-ed5e5cc712e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051393 Jun 15 10:33:59.541322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 812/1677] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:59.547196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.547840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.556329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.556777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.557597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.558037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.633221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.642537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-759fa83a-36a6-4268-80d2-b5bad7c59e98 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100110 Jun 15 10:33:59.643240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 813/1678] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:59.649954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.650892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.658317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.658766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.659560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.660001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.697754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0bf7066b-bdce-4462-954c-18fe39de52a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053275 Jun 15 10:33:59.698351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 814/1679] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:00.512629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.513551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.520646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.521175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.521969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.522439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.677175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.691005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ab02199-6e23-47bd-9882-23264ea7eeae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.181898 Jun 15 10:34:00.692159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 815/1680] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:00.701172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.702672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.713922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.714705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.716070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.716646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.752879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f02af2c5-7082-48ea-a972-8a16ccb22094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059227 Jun 15 10:34:00.753504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 816/1681] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:00.758446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.759058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.766603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.766941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.767711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.768145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.834255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.843181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79f9941d-13bd-4c88-9868-c3169e1fbd77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088619 Jun 15 10:34:00.843772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 817/1682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:00.848451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.849406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.855584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.856046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.857221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.857652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.877220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:00.892440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4dffd9dc-8831-4aee-be2f-f4649e61dcf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047586 Jun 15 10:34:00.893044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 818/1683] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:01.710797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.711602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.728509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.728976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.732192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.732638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.883815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.892726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0612ab2a-eab9-4a9b-808f-d6eff93182b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186539 Jun 15 10:34:01.893340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 819/1684] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:01.898380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.899345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.906737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.907184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.908068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.908506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.940100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86b6fd9b-fee6-446a-b458-156a29e503b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Jun 15 10:34:01.940689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 820/1685] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:01.945234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.945904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.952485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.952930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.953804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.954245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.018162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:02.026276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa5336e2-97ce-45b5-b0bf-dc207d43da23 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.084544 Jun 15 10:34:02.026857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 821/1686] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:02.032023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:02.033152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:02.039792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.040244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.041054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.041640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.076069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bdaf5e8d-8c51-4875-8322-4834b4109129 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048038 Jun 15 10:34:02.076569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 822/1687] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:02.910597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:02.911548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:02.919258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.919709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.920492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.920928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.079112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.088744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-403f8d9e-68fc-4e88-ad20-992c202506c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.182236 Jun 15 10:34:03.089365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 823/1688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:03.096709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:03.100464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:03.105621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.107007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.109406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.109406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.147537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fedaa54c-cb93-4256-87ca-2cdf5ecc0ad8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057007 Jun 15 10:34:03.149315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 824/1689] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:03.153165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:03.154281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:03.161206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.161551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.162346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.162778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.240413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.248862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-33252e8c-558e-4129-9c68-60cbe4119a56 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.099660 Jun 15 10:34:03.249582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 825/1690] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:03 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:03.254716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:03.255728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:03.263737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.264330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.265294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.265825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.301214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16e7eb1b-7ff7-468d-abcb-fd2da9027e23 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050082 Jun 15 10:34:03.302158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 826/1691] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:04.108654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.109466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.126712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.127158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.127946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.128383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.484175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.497029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa6ce02a-b077-444c-9fc9-f897b186d3b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.392885 Jun 15 10:34:04.497871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 827/1692] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:04.503576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.504517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.511597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.512048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.513467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.513995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.548946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b4ad1bf-27a7-4557-a40a-1c3b3200af34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049943 Jun 15 10:34:04.549579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 828/1693] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:04.554529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.555168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.563000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.563496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.564352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.564836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.632822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.642077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-96400c78-11a3-46c1-bff0-b5b37fe0b1ea tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091396 Jun 15 10:34:04.642734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 829/1694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:04.647959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.648894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.655741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.656185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.656985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.657426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.692752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-605f74cd-ca60-4c7e-9d46-2370cb938beb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048762 Jun 15 10:34:04.693275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 830/1695] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:05.515712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.516788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.524827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.525575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.526757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.527414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.685477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.695171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b44e21e-7636-425a-8994-246ae1697ee8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.183875 Jun 15 10:34:05.695856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 831/1696] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:05.703304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.704442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.712239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.712873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.713826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.714358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.772095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3cc4efdc-0c16-48d6-9a7a-f93c8291d1e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074345 Jun 15 10:34:05.773113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 832/1697] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:05.780827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.781702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.789608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.790058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.790848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.791284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.866068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.876792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be40eae3-50b9-4a68-9f6c-b203af068dcc tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.101982 Jun 15 10:34:05.877709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 833/1698] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:05.885859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.888047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.893370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:05.899968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.904542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.904542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.904542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.964638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19143d0a-023c-4e67-9bf8-654c7d20a0a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085156 Jun 15 10:34:05.966054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 834/1699] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:06.717382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.718130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.725663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.726112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.726906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.727347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.732206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:06.876512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.885017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d4ed7dd-54c2-4e13-9337-78c301790297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.171565 Jun 15 10:34:06.885599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 835/1700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:06.892089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.908916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.908916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.908916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.908916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.909568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.937188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3686aba0-b83b-4291-9749-cde0a6695da3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050427 Jun 15 10:34:06.937958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 836/1701] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:06.945737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.946493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.954321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.954786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.955587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.956008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.027609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.035888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6d83115-51bb-4e4f-8aec-34792c9d8990 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.096485 Jun 15 10:34:07.036502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 837/1702] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:07.041738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:07.042684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.050983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.051437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.052306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.052747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.087643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b184baa4-9a24-4ad5-a0ed-591cbdca8f89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049959 Jun 15 10:34:07.088247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 838/1703] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:07.929967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:07.931159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.944067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.946095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.946388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.947181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.093129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.101458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b98c8fe4-f5d4-4442-b6a1-6183f033dcd5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.179167 Jun 15 10:34:08.102071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 839/1704] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:08.107929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.108866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.115425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.115872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.116649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.117142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.163985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8067afe0-835f-4d22-ae90-d1c3612950af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060196 Jun 15 10:34:08.165069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 840/1705] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:08.174477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.175618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.187037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.187749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.189147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.189932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.259904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.268533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d410028-c099-411a-a012-b20ad65e0431 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.101974 Jun 15 10:34:08.269168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 841/1706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:08.274134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.275059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.282262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.282712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.283498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.283929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.318660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-34c29d68-dffe-4a9f-aef3-4e21f3c67767 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048374 Jun 15 10:34:08.319258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 842/1707] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:09.122260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.123186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.130289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.130730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.131511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.131941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.310925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:09.323588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-570324fa-acb5-4394-a5ad-bb703f83eacb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.205194 Jun 15 10:34:09.333043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 843/1708] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:09.333043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.333488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.344332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.345042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.346321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.347028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.384745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-40690d91-87ce-4b0c-b479-276c1fffec8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058712 Jun 15 10:34:09.385294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 844/1709] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:09.391148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.397416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.398574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.399020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.399794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.400222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.471041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:09.479428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c31f0be9-b5e5-47c1-ba10-9e634c2a77e9 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093050 Jun 15 10:34:09.480080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 845/1710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:09.486469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.487403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.494184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.494620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.495501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.495936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.532258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e9724df-4f57-4edf-9588-b6e54433c30b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050966 Jun 15 10:34:09.532943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 846/1711] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:10.344328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:10.345091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:10.351952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.352398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.353216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.353645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.505649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.517728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65dcd7ba-1d10-49b5-8447-2030eb3a3c2a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.177966 Jun 15 10:34:10.518626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 847/1712] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:10.527209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:10.529351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:10.539936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.540596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.541856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.542591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.581106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53cd7d87-272e-403c-8763-d53aaaf599e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060966 Jun 15 10:34:10.581699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 848/1713] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:10.587065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:10.587683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:10.595130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.595492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.596279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.596712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.681706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.691396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3bd3cf94-0ade-483d-89bf-52ce8becc188 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.108549 Jun 15 10:34:10.692210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 849/1714] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:10 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:10.698142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:10.699216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:10.707063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.707506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.708300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.708724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.744036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0961aac8-2871-4c7c-8262-4eb196b9bc5b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050174 Jun 15 10:34:10.744682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 850/1715] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:11.536651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.537710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.545352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.545772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.546567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.547019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.737590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.741561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:11.749077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-229a7a42-6017-44d3-b37c-95e4e773cc55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.216352 Jun 15 10:34:11.749671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 851/1716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:11.755548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.756484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.764508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.765036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.765824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.766254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.801944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bee50b11-b76e-4f70-9fb0-9f4b39fc80d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051157 Jun 15 10:34:11.802535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 852/1717] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:11.807675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.809304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.816772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.817441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.818387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.818828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.901899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.910384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-400c1cda-8d5f-4858-9d8e-72c12e12a1c2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.106721 Jun 15 10:34:11.910985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 853/1718] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:11.915952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.916947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.923637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.924078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.924867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.925325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.961998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c394cd58-2b2f-4ffd-8e93-43da16fe7660 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049896 Jun 15 10:34:11.962600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 854/1719] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:12.770378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:12.771091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:12.778347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.778849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.779694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.780389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.935134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:12.948613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4ed5c43-28e6-4a4c-97c0-1c125d7bb113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.181784 Jun 15 10:34:12.950223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 855/1720] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:12.958573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:12.959750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:12.967301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.967746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.968527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.968997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.002949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f579c84-0539-437c-acf5-d6a4234d1cc0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051221 Jun 15 10:34:13.003534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 856/1721] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:13.008475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:13.009128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.020474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.021317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.022758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.023541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.118508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:13.127271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e38aee4e-de75-4097-a7a5-ff87fb1ee3ba tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.122680 Jun 15 10:34:13.128180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 857/1722] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:13 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:13.133267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:13.134219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.141327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.141770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.142646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.143075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.179448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df6c00c6-12eb-49b8-8acb-a410e518c339 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050136 Jun 15 10:34:13.180104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 858/1723] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:13.968938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:13.969737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.977074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.977524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.978312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.978756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.138041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:14.151721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7482cfbf-2f93-4ecc-b5ab-1194d2456458 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.187468 Jun 15 10:34:14.152314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 859/1724] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:14.158915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:14.159867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:14.166550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.167001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.167797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.168522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.202777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-723b029c-2ccd-4f08-9ed9-931d17d2ccb6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048747 Jun 15 10:34:14.203387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 860/1725] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:14.208404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:14.209154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:14.216913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.217400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.218310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.218747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.294048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:14.302927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69c490c4-f35e-46aa-904f-58dbbd240b46 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098450 Jun 15 10:34:14.303531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 861/1726] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:14 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:14.308518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:14.310169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:14.317383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.317834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.318687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.319137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.353760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4dce956-f54e-4104-9e25-2a1fbdff453e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049109 Jun 15 10:34:14.354351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 862/1727] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:15.171202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:15.172254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:15.178998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.179449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.180244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.180687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.332856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.342338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b67e79b1-123c-40ce-b080-d2669e1d6126 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175668 Jun 15 10:34:15.342960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 863/1728] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:15.347920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:15.348827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:15.355530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.356941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.357113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.357521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.394494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-945312b1-4281-4fa1-9eaf-a38ef13d2e08 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050449 Jun 15 10:34:15.398423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 864/1729] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:15.400215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:15.400833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:15.408084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.408536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.409373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.409840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.477986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.486331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee69376e-ae27-4b3b-b562-ba9741e9aa30 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090023 Jun 15 10:34:15.486933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 865/1730] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:15 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:15.492409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:15.493409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:15.501968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.502514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.503397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.503881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.540812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4d8f2c15-e906-4a19-8e99-55069bd277f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052652 Jun 15 10:34:15.541921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 866/1731] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:16.363010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.363733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.371170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.372257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.373680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.374169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.538223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.553143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51572c4f-01c4-4681-aa73-b54fc8b4a48b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193628 Jun 15 10:34:16.554191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 867/1732] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:16.563140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.564585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.576411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.577223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.578606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.579384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.613654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:16.640483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77ebb7fb-a187-4433-9e64-f482a4d4acf0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084198 Jun 15 10:34:16.641564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:16.650517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.651594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.663828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.664655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.666076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.666872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.740183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.749678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fbe7e4fe-04b6-4558-9a49-13f1007b3240 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.106523 Jun 15 10:34:16.750513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 869/1734] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:16.759918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.761619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.770855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.771342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.772161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.772694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.811599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5022b21a-22d5-4c29-8cd5-aa51685d70fb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059639 Jun 15 10:34:16.812193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 870/1735] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:17.572757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.573685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.581507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.581949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.582740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.583173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.753497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.762647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f717c896-b73d-4a57-9d77-019249921261 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.193429 Jun 15 10:34:17.763236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 871/1736] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:17.768188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.769173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.776348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.776792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.777620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.778053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.815690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7525795d-5c25-47ba-8169-cfb4d0650d56 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051211 Jun 15 10:34:17.816174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 872/1737] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:17.821198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.821814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.829043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.829499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.830283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.830711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.904635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.914853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b76e8ea3-20a2-48d4-95d9-4b06aa19e9be tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.097263 Jun 15 10:34:17.915679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 873/1738] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:17.923895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.925633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.936687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.937492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.938811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.939550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.976837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f0cba2e-22d4-4961-b04c-977f99618015 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059979 Jun 15 10:34:17.977567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 874/1739] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:18.782734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:18.783456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:18.791144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.791663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.792454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.792952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.944525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.953230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a50a9a9b-1d28-4033-8c21-90ccd81779cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174461 Jun 15 10:34:18.953859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 875/1740] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:18.958997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:18.960041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:18.966871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.967312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.968091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.968518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.008063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1fa934d4-de28-4478-a8c0-4b2bc0420217 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053019 Jun 15 10:34:19.008736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 876/1741] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:19.014396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.015065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.021601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.022029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.023190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.023631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.089538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:19.097819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f2b35f7-1fa9-4678-b7c2-4b047d41bb6f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.087782 Jun 15 10:34:19.098478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 877/1742] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:19.103307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.104210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.111493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.111961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.112773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.113234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.153445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-782eb3c8-11e1-4934-a19e-67ed0802344d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053462 Jun 15 10:34:19.153978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 878/1743] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:19.980721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.981987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.988968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.989440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.990216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.990645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.135837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:20.144539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6cf999e9-65b4-4bba-8453-2d505733adbe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.168026 Jun 15 10:34:20.145151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 879/1744] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:20.150019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.150949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.157932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.158404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.159183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.159658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.194042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79fdd39b-77f6-4247-a320-b2024895710a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Jun 15 10:34:20.194637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 880/1745] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:20.202781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.203484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.210102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.210804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.211619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.212054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.278333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:20.286464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d9a31f37-89bc-4e92-8af0-bd4c036189fe tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090756 Jun 15 10:34:20.287058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 881/1746] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:20.291947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.292875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.304481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.305341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.306282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.306762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.341369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2dd81c8d-6275-4ce5-9f38-e74e198a23ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053179 Jun 15 10:34:20.341952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 882/1747] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:21.171773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:21.172786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:21.179592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.180093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.180916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.181445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.344809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:21.353402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03650b90-f086-4f10-9593-af31e5e13a12 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185505 Jun 15 10:34:21.354501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 883/1748] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:21.360833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:21.361861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:21.365806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:21.369869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.370316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.371792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.372792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.407601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-735e9332-eba7-4c52-8037-48a984db4780 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051853 Jun 15 10:34:21.408193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 884/1749] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:21.412888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:21.413539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:21.420987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.421450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.422297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.422670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.427730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:21.494435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:21.503593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ac7f22f1-9b07-45f1-bb19-40c502696da1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094313 Jun 15 10:34:21.504201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 885/1750] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:21 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:21.509513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:21.510448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:21.517424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.517868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.518758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.519192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.561032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b60a55b4-234a-463b-849c-19ec8460d334 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055636 Jun 15 10:34:21.561655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 886/1751] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:22.374476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:22.375777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:22.388742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.389305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.390253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.390765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.546870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.560151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc1b48fe-7997-4d14-9509-fcf5e9844a18 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190776 Jun 15 10:34:22.560747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 887/1752] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:22.566986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:22.568172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:22.576884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.577703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.579012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.579571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.635255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f354c0d-694f-4f98-af04-ccc1746bbe0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072892 Jun 15 10:34:22.636226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 888/1753] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:22.645279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:22.646410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:22.657948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.658704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.660083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.660856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.764621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.779640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0042d1b6-3231-46af-bddd-8bcae1252826 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.141030 Jun 15 10:34:22.780698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 889/1754] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:22 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:22.789598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:22.791470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:22.802473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.803279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.804666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.805475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.861459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c83e46f-3e24-4213-83d6-98dedacf007b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079107 Jun 15 10:34:22.862302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 890/1755] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:23.584255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.585430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.599940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.600736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.602199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.602964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.762483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.770993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed706033-8d17-4dc9-846b-899fc145536a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.194155 Jun 15 10:34:23.771813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 891/1756] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:23.776678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.777951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.784677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.785145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.785920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.786353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.830468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c4db5c9c-bd82-4f80-8624-6fe98cc474c6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057068 Jun 15 10:34:23.831438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 892/1757] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:23.841818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.842969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.854078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.854880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.856421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.857281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.931138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.940425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b605fbf2-e545-4c76-968a-2730fae882ad tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.107322 Jun 15 10:34:23.941040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 893/1758] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:23.946132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.947075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.955390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.955837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.956630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.957111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.991540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f6e4a3a-683b-4686-84c5-af81d86be914 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049385 Jun 15 10:34:23.992129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 894/1759] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:24.790385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:24.791202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:24.799153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.799582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.800376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.800814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.967771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:24.976599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bcb175a1-906d-4b8e-a0bb-2b1183a87c17 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.190275 Jun 15 10:34:24.977227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 895/1760] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:24.982903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:24.983848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:24.990961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.991660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.992174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.992601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.028740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93eed01f-b80b-4d8e-aa17-95e3e90186e3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050323 Jun 15 10:34:25.029377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 896/1761] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:25.034334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:25.034954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:25.041761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.042204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.043513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.044630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.118886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:25.128557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0be1cc58-006b-4f71-8cf8-7276b645b7f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.098097 Jun 15 10:34:25.129255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 897/1762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:25 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:25.134441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:25.135387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:25.143193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.143634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.144413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.144839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.178986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e9058ab5-bb55-4aef-8816-d23edfe4daf4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048586 Jun 15 10:34:25.179578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 898/1763] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:25.998012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:25.998840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.005606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.006049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.006824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.007256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.158983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.167608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5720ee9a-2272-4f07-b5c9-fb527dcf3fb7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.174116 Jun 15 10:34:26.168385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 899/1764] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:26.173775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:26.175303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.182642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.183133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.184488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.185085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.220267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a260cd2-022f-46da-b255-bd6ab58cdd7b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050764 Jun 15 10:34:26.220849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 900/1765] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:26.226273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:26.226891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.233664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.234106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.234873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.235305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.302753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.306348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:26.311722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2bc7ae8d-a3af-4c1d-b3f7-a245b10f3a27 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089789 Jun 15 10:34:26.312316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 901/1766] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:26 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:26.317258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:26.323274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.325437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.325889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.326671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.327103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.360310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50217f0d-aa63-42bb-bba8-46aed0b3d084 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046889 Jun 15 10:34:26.360896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 902/1767] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:27.187712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.188603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.196091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.196584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.197543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.198030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.348659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:27.358229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68b3fc82-5882-420d-8b1a-728e02404f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.176221 Jun 15 10:34:27.358931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 903/1768] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:27.364315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.365563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.373676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.374308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.375227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.375765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.411751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4e15746c-3201-475e-86cb-3030b09645e4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051518 Jun 15 10:34:27.412366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 904/1769] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:27.417558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.418473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.426145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.426632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.427532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.428004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.494377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:27.503284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45198964-357a-40c3-9482-6a593cc2ca8c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089605 Jun 15 10:34:27.504026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 905/1770] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:27.509586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.510623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.519307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.519754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.520604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.521084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.555580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-02470411-8c1a-4069-b244-d00cdb0516db tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050391 Jun 15 10:34:27.556169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 906/1771] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:28.378969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:28.379720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:28.387935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.388535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.389342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.389774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.539050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:28.550035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3e561e9-f24b-49d2-9680-f1d144fd0272 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.175155 Jun 15 10:34:28.550657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 907/1772] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:28.557111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:28.559052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:28.566790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.567229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.568004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.568433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.602421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-684b421f-fd30-4a24-bdf1-91860c6b37ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050527 Jun 15 10:34:28.603001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 908/1773] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:28.608021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:28.608627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:28.615411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.615857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.616637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.617116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.690548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:28.699728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d0822b9-9cc9-4af0-995f-b2bf73dd75d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095600 Jun 15 10:34:28.700342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 909/1774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:28 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:28.705377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:28.706318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:28.713598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.714051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.714859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.715296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.750524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-97a5f513-4d2b-4417-adf6-9585b2df400b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049054 Jun 15 10:34:28.751106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 910/1775] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:29.570393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:29.571185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:29.579068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.579669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.580638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.581230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.761050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.770206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a2cb1d0-f11c-4592-8463-7511a03f9351 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.203873 Jun 15 10:34:29.770796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 911/1776] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:29.776282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:29.777359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:29.784492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.784933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.785741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.786171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.820180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4fc8923a-1884-464a-94da-6b47e3f69574 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Jun 15 10:34:29.820891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 912/1777] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:29.826301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:29.826917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:29.833650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.834103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.834899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.835334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.909121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.917506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aee453e4-083a-48f1-9103-1160e9d526bf tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.095554 Jun 15 10:34:29.918153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 913/1778] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:29 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:29.927777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:29.927777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:29.931533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.931981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.932770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.933252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.969128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7cc53e4e-cb1b-47da-ac9b-f0b5869bb5c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049706 Jun 15 10:34:29.969732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 914/1779] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:30.788499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:30.789572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:30.798393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.798840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:30.799629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.800122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.069400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.078301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f27fa031-af1b-46a6-8c89-96d8315c4e08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.293602 Jun 15 10:34:31.078891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 915/1780] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:31.083842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:31.084786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:31.092064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.092507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.093317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.093753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.129939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2017b820-0da4-4212-b934-709e92fbbd72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049938 Jun 15 10:34:31.130525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 916/1781] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:31.135349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:31.136011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:31.143345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.143794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.144561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.145113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.213960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.222913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-122343fa-b812-4ddc-8df8-ed7c3bd72f03 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.091348 Jun 15 10:34:31.223493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 917/1782] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:31.228324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:31.229216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:31.237169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.237618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.238398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.238831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.257218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:31.270914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ff0a8f42-b4be-4c19-9541-a884c88f6b5d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046334 Jun 15 10:34:31.277851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 918/1783] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:32.098142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.098844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.105336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.105867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.106555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.106991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.255286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.263730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23e0e6d5-a82e-42d2-93e0-6b91bfee1fe1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.170792 Jun 15 10:34:32.264326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 919/1784] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:32.273815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.273815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.277629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.278552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.279152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.279590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.314824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53af6149-ce70-4c33-b810-6a0df77d1200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049321 Jun 15 10:34:32.325972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 920/1785] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:32.325972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.325972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.329240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.330073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.331438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.332168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.429472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.438976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fb64157-0665-4303-af4b-838acf33c26c tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.122488 Jun 15 10:34:32.440493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 921/1786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:32.444747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.445804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.452719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.453203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.453998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.454446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.488542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-49b796a0-0b9f-4a28-a858-846fa1268928 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047788 Jun 15 10:34:32.489258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 922/1787] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:33.282572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.283234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.290443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.290890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.291675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.292109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.453051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:33.462305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-33948bcd-f582-48ef-9890-e75cd9db6394 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.184743 Jun 15 10:34:33.464223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 923/1788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:33.470374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.471614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.478874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.479316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.480096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.481292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.518215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9699618-e400-437d-b62d-1fa884c2417d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054217 Jun 15 10:34:33.518900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 924/1789] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:33.525502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.527330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.538449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.539017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.539931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.540466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.612031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:33.620660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e67796d8-fd71-4a84-bb56-5de600ac8e78 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.100584 Jun 15 10:34:33.622087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 925/1790] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:33.628737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.629770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.637564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.638004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.638849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.639291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.673102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7331915-16ee-4eec-81ff-4c0c0ff42f49 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049699 Jun 15 10:34:33.673706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 926/1791] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:34.480620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:34.481670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:34.488273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.488721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.489548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.489984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.641850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:34.650472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-96692cc5-b383-44c8-9627-78b9add62522 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173917 Jun 15 10:34:34.651051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 927/1792] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:34.655869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:34.656836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:34.663449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.663885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.664660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.665122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.706142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e5d8d3ca-b77d-454d-99d9-c588140ac6d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053998 Jun 15 10:34:34.706730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 928/1793] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:34.711491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:34.712101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:34.719257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.719732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.720509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.720944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.785834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:34.796231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ebce1890-4dcf-493f-b9ac-31e886c457d2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.088339 Jun 15 10:34:34.796858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 929/1794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:34 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:34.802161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:34.803183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:34.812945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.813662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.814918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.815673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.851813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a25ead2b-bf49-46da-9b70-0e8b07c0b528 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053756 Jun 15 10:34:34.852397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 930/1795] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:35.671851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:35.672904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:35.685846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.686542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.688272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.688722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.871352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:35.884614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-492fc905-5234-4e67-815b-fa6462231545 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.219822 Jun 15 10:34:35.885702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 931/1796] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:35.903015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:35.904309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:35.913101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.913824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.914564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.915530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.951473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f7c5080-0422-42e2-9e3a-bb9c467532c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056723 Jun 15 10:34:35.952071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 932/1797] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:35.960259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:35.961174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:35.970289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.970798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.972102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.972733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.041801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.051050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc995347-7c40-4e28-b836-8350bf6eef7d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094518 Jun 15 10:34:36.051676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 933/1798] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:36.056914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:36.057857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:36.061427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:36.065837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.066295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.067194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.067633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.101651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-637e104d-1024-49ef-be70-fe1c9b83c34d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048803 Jun 15 10:34:36.102239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 934/1799] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:36.911797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:36.912540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:36.920187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.920628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.921529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.921961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.926569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:37.067680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.077598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eda6846e-819f-4484-96b1-c5203110ea00 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.169750 Jun 15 10:34:37.078196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 935/1800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:37.083252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.084176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.091339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.091779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.092567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.093027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.127377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-325533af-9bca-4163-a0c3-668bed9b248e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048073 Jun 15 10:34:37.127987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 936/1801] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:37.133043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.133786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.141027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.141635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.142534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.143106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.213641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.224042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2efd0dbd-085c-4655-a45c-bb9bfcad9209 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.094967 Jun 15 10:34:37.224647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 937/1802] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:37.230151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.231064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.237910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.238364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.239155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.240258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.301277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-727bef90-58f9-4cd8-a61e-3ae51d65fecd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074885 Jun 15 10:34:37.302335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 938/1803] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:38.097751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.098795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.106029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.106478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.107272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.107710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.258557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.267367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-692cb26c-32d6-45b4-bc75-501a9d8118df tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.173542 Jun 15 10:34:38.267987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 939/1804] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:38.272929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.273917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.281593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.282042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.282830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.283266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.316906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-980913ea-ad59-4634-977d-851179c59855 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047805 Jun 15 10:34:38.317698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 940/1805] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:38.322923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.323530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.330195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.330637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.331421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.331856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.399681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.408402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-945571f8-dea7-43e0-a7d2-0849e7184050 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089466 Jun 15 10:34:38.409025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 941/1806] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:38.414281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.415219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.423279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.423772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.424718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.425301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.459759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93403590-4f27-4856-bdb2-5aec3838d4de tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049622 Jun 15 10:34:38.460443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 942/1807] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:39.286789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.287847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.297597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.298161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.298827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.299263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.469001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:39.477195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed7f3615-053c-492b-a14c-c8be0c64fdb3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.194706 Jun 15 10:34:39.477741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 943/1808] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:39.482816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.483767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.490269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.490724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.491517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.491944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.524558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5689485-9268-4b27-a731-c5a43156bc46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Jun 15 10:34:39.525178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 944/1809] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:39.529969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.530576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.537032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.537524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.538317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.538795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.607508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:39.615745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b30cf123-29df-4a97-81e4-e256a3794cf4 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089495 Jun 15 10:34:39.616330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 945/1810] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:39.621786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.622891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.629458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.629908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.630677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.631108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.663756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c115944f-62b8-4fcf-a54c-3b09e69ecd07 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046340 Jun 15 10:34:39.664339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 946/1811] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:40.494551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.495302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.503389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.504313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.505177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.505924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.666730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.677065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b6efc1a-53e2-418e-b1f1-9ab898a4f409 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.186293 Jun 15 10:34:40.677658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 947/1812] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:40.682845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.684390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.691363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.691821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.692597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.693072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.726696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc1320f3-e6f1-4d06-bfa5-44b0befa7d9d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047943 Jun 15 10:34:40.727286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 948/1813] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:40.732660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.733314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.739801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.740268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.741103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.741536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.807466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.815654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9743082-4f46-496a-9b7c-d553a2275317 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.087296 Jun 15 10:34:40.816245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 949/1814] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:40.821256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.822177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.829454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.829908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.830694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.831131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.865915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4f335f5-7e53-4fcf-aad2-1e2cb686076d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048574 Jun 15 10:34:40.866504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 950/1815] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:41.700047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:41.701358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:41.713165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.713941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.716705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.717496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.879795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.882953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:41.890473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-322f8e6f-ab91-4bfc-b977-b36d4212c000 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.196084 Jun 15 10:34:41.891081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 951/1816] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:41.895842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:41.896771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:41.903672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.904123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.904918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.905393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.939240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-08669891-668a-4965-a17c-5daa7edd70b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047043 Jun 15 10:34:41.939834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 952/1817] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:41.944717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:41.945372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:41.952507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.952975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.953770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.954209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.023226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:42.031773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d6a943a-c9fb-44fc-804d-38b493c8fb11 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090891 Jun 15 10:34:42.032356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 953/1818] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:41 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:42.037772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:42.038720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:42.045562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.046007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.046783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.047219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.079072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e966db94-37cd-4100-9ea7-a0417af45955 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045551 Jun 15 10:34:42.079554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 954/1819] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:42.908267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:42.908943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:42.915858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.916290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.917094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.918021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.056928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.065948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9545bed-c16b-4a28-b9ec-86f40249928c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.161499 Jun 15 10:34:43.066543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 955/1820] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:43.071392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:43.072323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:43.078771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.079225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.080010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.080452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.113609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92b0c8dc-47d3-49d3-9e29-2e0c3f924716 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Jun 15 10:34:43.114195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 956/1821] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:43.118893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:43.119506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:43.127036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.127486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.128268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.128712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.197191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.205596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0603cdce-bdc8-4cac-8918-1fa4b9aba8f2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.090348 Jun 15 10:34:43.206201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 957/1822] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:43 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:43.211324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:43.212253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:43.219951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.220434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.221248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.221693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.259952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0df66319-040f-45b0-9101-b45ae5a910f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052253 Jun 15 10:34:43.261019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 958/1823] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:44.084028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.084720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.092077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.092520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.093319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.093749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.249994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.265427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7b680f55-b547-4536-adc9-e7412423b657 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.185054 Jun 15 10:34:44.266482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 959/1824] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:44.275803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.277472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.285988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.286490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.287591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.288277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.335506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-256084d7-6f59-4d18-b7cd-edf6d9fe2561 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067528 Jun 15 10:34:44.336354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 960/1825] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:44.340943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.341578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.347756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.348204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.348991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.349429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.412103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.420608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4141823-6c1d-48ef-82f8-50ee296bdea7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.083251 Jun 15 10:34:44.421290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 961/1826] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:44.426172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.427299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.435267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.435741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.436886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.437354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.467828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c3a6a5f-c22d-4c20-8f8d-cd51bd254d9d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045461 Jun 15 10:34:44.468383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 962/1827] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:44.752164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.752678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.759330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.759767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.760535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.760979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:54.756773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=58 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:54.781712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=70 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:19.080041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:35:19.080726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:35:44.841990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:35:44.945439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:35:50.148435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:35:50.149063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:35:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:35:54.846598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:54.949751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:10.758240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:36:10.758909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:36:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:36:49.636557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:36:49.637174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:37:11.121935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:37:11.122657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:37:12.091480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:37:12.092289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:37:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:37:45.285107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.286183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c8636e16-9167-4ee6-b351-e2ea3e06d65a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 202 len: 0 microversion: 2.1 time: 240.590074 Jun 15 10:37:45.287041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 866/1828] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:33:44 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 240592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:37:45.288628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:37:45.289989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:37:45.290617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:37:45.293435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.295761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.297013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) Jun 15 10:37:45.298903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.300326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5099762a-737c-4aff-a4c1-b213e0004682) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:45.300326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae02c960-6072-4af4-bf25-d2f50fba3211 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 180.542205 Jun 15 10:37:45.300326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 963/1829] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:34:44 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 269 bytes in 180544 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:37:45.300600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.300600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.303421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.304059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.305220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.305665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.313935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.328033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.328033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.328033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.328033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.328596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.355514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4bdecc1-fa47-4979-b3e6-824846e9f0c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Jun 15 10:37:45.356657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 964/1830] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:37:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:45.361204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.365551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.368083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.368538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.369915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.370678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.441208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:45.445860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:45.447225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-724c3843-329a-475a-ae99-3552c9127e97 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.089459 Jun 15 10:37:45.447977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 965/1831] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:45 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:45.454111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d2dfab5-8e78-43ce-b522-c1fa26d8582c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.165438 Jun 15 10:37:45.454111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 867/1832] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:45.459711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.460550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.467099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.467552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.468327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.468761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.501151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.502059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.508228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.508672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.509467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.510388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.540477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6038011-9af7-4356-8581-b61f846bede6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091166 Jun 15 10:37:45.541331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 966/1833] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:37:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:37:45.609896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.610185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.617535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.617977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.618739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.623620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:55.464533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:55.488027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:55.614136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:55.643774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=22 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:39.088599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:38:39.089320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:39:30.766677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:39:30.767298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:39:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:39:45.744379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:39:45.789145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:39:55.748568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:55.793235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:09.645569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:40:09.646277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:40:31.130655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:40:31.131328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:40:32.100515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:40:32.101150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:40:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:40:50.158398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:40:50.159171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:41:45.939214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:41:45.943415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:41:45.947374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:41:45.948920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:41:45.951232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:45.954669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:41:45.956883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) Jun 15 10:41:45.960155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4b8e7a6-2f26-4ab5-bc1d-8cc02ae04b77) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 240.489003 Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:45 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (10.222.0.60) Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-6ca83a32-6529-4f40-b69d-f50cc620782f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Unhandled error: OSError: write error Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:41:45.963044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:41:45.964462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 868/1834] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:37:45 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 240491 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.209152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.211079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.222529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.223357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.224855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.225690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.242117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 202 len: 0 microversion: 2.1 time: 240.698372 Jun 15 10:41:46.243060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:41:46.243060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (10.222.0.60) Jun 15 10:41:46.243811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-f0d52832-76ef-4f56-9869-2cb41c77c9d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Unhandled error: OSError: write error Jun 15 10:41:46.243811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:41:46.243811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:41:46.244355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 967/1835] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:37:45 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 0 bytes in 240703 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.440939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.442036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.445953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:46.450447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.450890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.451674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.452089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.454396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.506450 Jun 15 10:41:46.454923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:41:46.454923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (10.222.0.60) Jun 15 10:41:46.455515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-5c4d46d0-da6d-44a0-8ad3-00aca5f5d5d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Unhandled error: OSError: write error Jun 15 10:41:46.455515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:41:46.455515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:41:46.455795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 869/1836] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.460190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.460802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.467952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.474767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.474767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.474767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.484136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238362 Jun 15 10:41:46.484663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:41:46.484663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (10.222.0.60) Jun 15 10:41:46.485566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-3845717e-17e8-45bf-8dee-0401ea77149d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Unhandled error: OSError: write error Jun 15 10:41:46.485566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:41:46.485566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:41:46.485845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 968/1837] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:41:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 0 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.490537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.491443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.498062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.498498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.499257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.499696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.534182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047425 Jun 15 10:41:46.534710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:41:46.534710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (10.222.0.60) Jun 15 10:41:46.535445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-58315c9d-94f7-4711-8fad-9b355a62bbcb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Unhandled error: OSError: write error Jun 15 10:41:46.535445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:41:46.535445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:41:46.535756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 969/1838] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:41:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.541165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.541410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:46.541657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.549263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.549708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.550473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.550631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1226 microversion: 2.1 time: 0.093934 Jun 15 10:41:46.550900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.551166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (ip 10.222.0.60) !!! Jun 15 10:41:46.551166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:41:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (10.222.0.60) Jun 15 10:41:46.551783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-03ee89ba-b078-4334-82b3-733889a51576 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Unhandled error: OSError: write error Jun 15 10:41:46.551783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:41:46.551783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:41:46.552030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 870/1839] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:46 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:41:46.557680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.558186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.564423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.564867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.565682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.566121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:56.546447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:56.561706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:56.575748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:56.587131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=16 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:59.096411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:41:59.097017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:42:50.774379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:42:50.775055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:42:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:43:29.654263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:43:29.654847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:43:46.510152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:43:46.731941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:43:52.109218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:43:52.109899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:43:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:43:56.514751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:56.745270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:10.166982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:44:10.167735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:45:19.105532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:45:19.106164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:45:30.068927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:30.071095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.072516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.075498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.076655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.078326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.079761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) Jun 15 10:45:30.082497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c824c5b7-d0b9-489d-ab0c-5e4857d19f97) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 223.536041 Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (10.222.0.60) Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-25b381e7-d83e-484c-b646-0c0f7c14ab56 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Unhandled error: OSError: write error Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.083816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.084409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 970/1840] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:41:46 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 223538 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.084409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.084409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.089814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.090469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.091248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.091687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.107509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:30.109461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.110817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.112916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.114167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.115414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.116688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) Jun 15 10:45:30.118029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c3eadb3a-137a-48ce-a9c8-a02f11f66f60) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 223.558176 Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (10.222.0.60) Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-42152006-a3ff-4903-8e41-b16abaf2291f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Unhandled error: OSError: write error Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.120170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.120746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 871/1841] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:41:46 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 0 bytes in 223565 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.125889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.128478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.135260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.135789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.136676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.137220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.171313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051046 Jun 15 10:45:30.171824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:30.171824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (10.222.0.60) Jun 15 10:45:30.172408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-a98230db-130a-45d0-a1d2-9be4181e5dc4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Unhandled error: OSError: write error Jun 15 10:45:30.172408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.172408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.172675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 872/1842] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.177836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.178064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.184613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.185099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.185874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.186311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.220828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.221659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.222123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lazy-loading 'fault' on Instance uuid 1bd0d535-7284-4990-a7aa-9cb616268d39 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.233853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:30.242748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.168135 Jun 15 10:45:30.243256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:45:30.243471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (10.222.0.60) Jun 15 10:45:30.244042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-5a3ad699-7188-4ced-acb7-ad5b07083219 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Unhandled error: OSError: write error Jun 15 10:45:30.244042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.244042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.244317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 971/1843] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.248720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.249708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.257405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.258113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.258877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.259300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.265772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:30.274299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1231 microversion: 2.1 time: 0.100769 Jun 15 10:45:30.274813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (ip 10.222.0.60) !!! Jun 15 10:45:30.274813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (10.222.0.60) Jun 15 10:45:30.275423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-1c84e9c3-bc80-48ce-8e9a-c59edd6b7c81 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Unhandled error: OSError: write error Jun 15 10:45:30.275423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.275423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.275663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 873/1844] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.280450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.280828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.286762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.287204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.287985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.288400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.290305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045132 Jun 15 10:45:30.290826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:30.290826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (10.222.0.60) Jun 15 10:45:30.291395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-b1179f23-eb5d-4f78-b473-cab9401ba62d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Unhandled error: OSError: write error Jun 15 10:45:30.291395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.291395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.291730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 972/1845] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.296091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.296575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.304077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.304930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.305734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.306193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.374694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.422176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.453899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:30.456063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.457651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.458670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.459891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.461261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.462297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) Jun 15 10:45:30.463989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-71677801-1139-488f-a786-99344ec1e926) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.181091 Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (10.222.0.60) Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-c01390d2-841b-4771-85b0-09800661999a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Unhandled error: OSError: write error Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.466513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.467342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 874/1846] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:30 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.467342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.467342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.471352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.471834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.472581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.473113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.493148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:30.494780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.496253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.496905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.497990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.499870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.501123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) Jun 15 10:45:30.508649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-19bf9f35-1053-4c53-a63e-510b185023b5) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.203788 Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (10.222.0.60) Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-5998c023-fb08-4081-9aa0-a229d34930f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Unhandled error: OSError: write error Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.510192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.510770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 973/1847] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:30 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 0 bytes in 205 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.510770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.510770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.510770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.511136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.511238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.511671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.559862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060951 Jun 15 10:45:30.560703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:30.560703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (10.222.0.60) Jun 15 10:45:30.561318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-30cbbcb4-0daa-4449-b0b3-5546a32a5d89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Unhandled error: OSError: write error Jun 15 10:45:30.561318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.561318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.561629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 974/1848] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.568289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.568289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.574055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.574505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.575358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.575852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.609360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.609800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.610244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lazy-loading 'fault' on Instance uuid 1bd0d535-7284-4990-a7aa-9cb616268d39 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.628045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:30.635929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.175877 Jun 15 10:45:30.636442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:45:30.636635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (10.222.0.60) Jun 15 10:45:30.637240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-3673791c-9040-4fb4-a76b-b90b9dd40c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Unhandled error: OSError: write error Jun 15 10:45:30.637240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.637240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.637530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 875/1849] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.641913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.645245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.649240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.649689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.650465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.650893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.653650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ac3d9b2893b4f078c2a379696aaff34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc3b6e0d964cb9937f0a57894554b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:30.662211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 200 len: 1231 microversion: 2.1 time: 0.099783 Jun 15 10:45:30.662738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (ip 10.222.0.60) !!! Jun 15 10:45:30.662738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (10.222.0.60) Jun 15 10:45:30.663323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-0b782d67-ad89-4748-a7d8-0178cebccfef tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Unhandled error: OSError: write error Jun 15 10:45:30.663323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.663323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.663568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 975/1850] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.668241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.668736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.676354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.677328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.678184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.678691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.682676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044309 Jun 15 10:45:30.683406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:30.683406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (10.222.0.60) Jun 15 10:45:30.683992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-de37566a-93de-4faa-9f62-58bdea73077a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Unhandled error: OSError: write error Jun 15 10:45:30.683992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.683992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.684240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 876/1851] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.688703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.689218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.695426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.699711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.699711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.699711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.761934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.804533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:30.833737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:30.836057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:30.837683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.838714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.840266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.841654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.842898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) Jun 15 10:45:30.844209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1e8ce57b-cb60-4e8e-9566-e35f2e61d64f) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.173052 Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (10.222.0.60) Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-c66ab4d2-ab51-4a1c-85fa-e1ec73d362c3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Unhandled error: OSError: write error Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:30.846919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:30.847540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 976/1852] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:30 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.847540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.847540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.851522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.851970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.852741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.853212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.869792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:30.871984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:30.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.874254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:30.875425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.878368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) Jun 15 10:45:30.879707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8d6aa662-d44b-4bff-a2f2-6bbb23aa0e92) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.188555 Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (10.222.0.60) Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-147ad6d3-76f9-46e6-93cc-ac24b38d93a8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Unhandled error: OSError: write error Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.880946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.881523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 877/1853] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:30 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 0 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.881523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.881702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.887998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.888441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.889280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.889707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.922728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Jun 15 10:45:30.923624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:30.923624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (10.222.0.60) Jun 15 10:45:30.924389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-d3e07cb8-571d-4112-a331-9a0966d06bab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Unhandled error: OSError: write error Jun 15 10:45:30.924389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.924389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.924765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 878/1854] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.929157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.929786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.936123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.936484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.937285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.937727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.952202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:30.953769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:30.955997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:30.956949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:30.959050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.029555 Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (ip 10.222.0.60) !!! Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:30 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (10.222.0.60) Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-43fe207d-2aa3-45d6-b879-0397a0e4af8b tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Unhandled error: OSError: write error Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:30.960910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 879/1855] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:30.961894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:30.962229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:30.968300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.968749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.969571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:30.969982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:30.992970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:31.000647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.160936 Jun 15 10:45:31.001139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043287 Jun 15 10:45:31.001254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:45:31.001254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (10.222.0.60) Jun 15 10:45:31.001638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:31.001638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (10.222.0.60) Jun 15 10:45:31.001823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-c00a6e40-0ee5-486a-9c5d-35b65882e7d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Unhandled error: OSError: write error Jun 15 10:45:31.001823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:31.001823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:31.001823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 977/1856] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.002770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-66298d88-8167-4ec4-b8d0-2334ad6f77c2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Unhandled error: OSError: write error Jun 15 10:45:31.002770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:31.002770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:31.003122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 880/1857] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.006562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.007051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.007438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.007920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.012947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.013418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.013617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.014064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.014181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.014590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.014817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.015245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.095408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:31.138273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:31.168029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:31.170229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.171783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.172811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.174828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.176172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.177459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) Jun 15 10:45:31.178735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97c091e2-fd5c-4558-86a4-c13548e19a72) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.168804 Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (ip 10.222.0.60) !!! Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 (10.222.0.60) Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-45f28443-6857-4343-b117-f26afc5dc3d3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Unhandled error: OSError: write error Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:31.179994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:31.180572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 978/1858] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 0 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.180572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.180572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.186697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.187139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.187889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.188426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.203696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:31.206152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:31.207617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.208315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.209426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.210724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.211817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) Jun 15 10:45:31.212977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-51ec0c9d-d139-4b88-8cc2-bc9e7aee1f78) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.204108 Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (ip 10.222.0.60) !!! Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b (10.222.0.60) Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-1173ac12-3518-4747-baf1-933d6dcb4d3f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Unhandled error: OSError: write error Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:31.214019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:31.214810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 881/1859] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 0 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.214810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.215074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.222076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.222748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.223521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.223959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.255373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Jun 15 10:45:31.255891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:31.255891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments (10.222.0.60) Jun 15 10:45:31.256468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-8d4413b1-b67f-439e-9c39-97b93f2c70f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Unhandled error: OSError: write error Jun 15 10:45:31.256468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:31.256468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:31.256732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 882/1860] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.260934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.261590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.267961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.268938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.269194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.269628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.292060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:31.293811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.295488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.296271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.297958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.037707 Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (ip 10.222.0.60) !!! Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 (10.222.0.60) Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-0455a640-1b60-4c58-afef-e4c90987ad77 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Unhandled error: OSError: write error Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:31.299827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 883/1861] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 0 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.301801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.302722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.310134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.311443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.312176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.312634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.326595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:31.335468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.161656 Jun 15 10:45:31.335956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:45:31.335956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (10.222.0.60) Jun 15 10:45:31.336546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: CRITICAL nova [None req-d7785cf7-fec8-42a1-98c7-24da4ec95d6e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Unhandled error: OSError: write error Jun 15 10:45:31.336546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova OSError: write error Jun 15 10:45:31.336546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova Jun 15 10:45:31.336820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 979/1862] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.341678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.342169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.346338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048373 Jun 15 10:45:31.346973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (ip 10.222.0.60) !!! Jun 15 10:45:31.346973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:45:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments (10.222.0.60) Jun 15 10:45:31.347558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: CRITICAL nova [None req-bef4fbc9-8aa3-4436-8ae8-9f2a2c72788d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Unhandled error: OSError: write error Jun 15 10:45:31.347558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova OSError: write error Jun 15 10:45:31.347558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova Jun 15 10:45:31.347819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 884/1863] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 15 10:45:31.349099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.349548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.350322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.350759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.352300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.352827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.358983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.359427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.360189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.360619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.435516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:31.487405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:31.517056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:31.520034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.521581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.522523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.523741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.525976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.527008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) Jun 15 10:45:31.528109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.529367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4e56934-1f6d-4786-bb15-b1ffed2f744d) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.529367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74c4dce0-2708-42b5-b3e6-17130674ae4a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.183884 Jun 15 10:45:31.529367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 980/1864] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:31.529367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.529752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.557376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:31.559642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:31.561293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.562044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.563119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.564283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.565410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) Jun 15 10:45:31.566959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.568227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d48e8bf2-b3b3-4f4d-9e2e-56f0466e1015) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.568227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f48a598b-16df-4a7a-82b3-ad25dca0e9a2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.212710 Jun 15 10:45:31.568227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 885/1865] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 269 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:31.568227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.568627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.574710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.575075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.576235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.576364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.611757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c70e54ed-f0cb-4af5-9767-68781554f1b0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048548 Jun 15 10:45:31.612444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 886/1866] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:31.617699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.618312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.627867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.633080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.633080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.633080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.646435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:31.647998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.650027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.650846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:31.652358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.654207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.654207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00654a5e-bafc-43e7-95f3-0c693c6432a7 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.035885 Jun 15 10:45:31.654207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 887/1867] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:31.655024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.655970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.664109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.664861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.665455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.665889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.692844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:31.697584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.701508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a72e6ff9-6db0-4918-a314-b3a7badda05b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046520 Jun 15 10:45:31.701652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.701760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 888/1868] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:45:31.701869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.701869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.703084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.703577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.710262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.710709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.711487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.711926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.802772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:31.845096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:31.853452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f100481-bb25-4f7c-843c-f18ee3ee7684 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.330417 Jun 15 10:45:31.854018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 981/1869] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1561 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:31.858706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.859402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.864788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.865624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.866075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.866843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:31.866984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:31.868495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.869257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:31.870572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.871964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.873203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) Jun 15 10:45:31.874509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:31.875821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.875916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-690c0122-cbab-4f96-bba9-8be8568b6aa7) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:31.875916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8318273-60a0-4e3b-9d6d-e74ff9cfc4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.169105 Jun 15 10:45:31.875916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 889/1870] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:31.875916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:31.876392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:31.883001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.883448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.884229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:31.884665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:31.952634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.023798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:32.026174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.028052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.029066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.030322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.031683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.032918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) Jun 15 10:45:32.034471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.035793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0defa995-2a01-4dbc-a22e-a63d60a145b2) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.035793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1f97585-e0bd-4cd8-add3-49120c13ff93 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.173055 Jun 15 10:45:32.035793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 982/1871] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:31 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.035793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.036136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.039760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:32.041147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.041613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.042384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.042819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.047561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cedced26-a46b-44db-8fe8-cf7c9a28357a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.177490 Jun 15 10:45:32.048117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 890/1872] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:32.052760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.053422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.059347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.059797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.060558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.061019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.073574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da9a710e-3eae-4ac3-b47f-a6ccbbacdb26 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Jun 15 10:45:32.074346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 983/1873] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:32.075609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:32.077200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.079056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.079883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.082078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.083300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.083300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21d31005-3f11-4a67-bcd4-2f603874f104 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.029543 Jun 15 10:45:32.083456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.083557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 891/1874] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:32.083660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.086454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.086907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.087427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.087683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.087921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.088118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.094116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.094562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.095325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.095850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.117541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64fccb01-d05f-4310-9719-4f6af2b9df67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042179 Jun 15 10:45:32.118120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 984/1875] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:45:32.122869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.123360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.130125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.130577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.131355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.131794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.150371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.182188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.226483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.256020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:32.258380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:32.259743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.260602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.261724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.262889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.264016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) Jun 15 10:45:32.265214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.266276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c706e3ee-9dab-4477-9458-f617f6f0ca24) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.266276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65865022-456a-47a1-ad85-60ddcf9bb71d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.179799 Jun 15 10:45:32.266276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 892/1876] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 269 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.266276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.266620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.272590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.273070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.273835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.274272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.292445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:32.294721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.296285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.297128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.299330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.300528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) Jun 15 10:45:32.301712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.302791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-59c56b22-35b6-472e-8f5d-67e2bef6fe33) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.302791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78d45ae0-50e6-469e-a960-816a7d51498c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.177131 Jun 15 10:45:32.302791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 985/1877] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.302791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.303093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.309775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.310220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.310972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.311398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.345031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-09b13f1f-5403-4792-8ef5-ae41e4926a2e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Jun 15 10:45:32.346210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 986/1878] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:32.350772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.351373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.357269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.357703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.358454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.358922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.373291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:32.374816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.376604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.378420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.380091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.381532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.381532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50954915-62b8-4161-8e19-9d711cf94f0d tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.029072 Jun 15 10:45:32.381532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 987/1879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:32.382643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.383539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.389386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.389826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.390579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.391008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.412375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:32.420460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-231b54f3-e6f1-4e19-a71f-32c51923789b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.158893 Jun 15 10:45:32.421039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 893/1880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:32.421743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3b90856-b90b-4770-b54f-6da84f26940c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042695 Jun 15 10:45:32.422288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 988/1881] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:45:32.426138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.426634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.427991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.428686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.432502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.432950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.433780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.434211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.434706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.435165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.435941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.436384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.516047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'services' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.559019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.588295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 HTTP/1.1 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:32.590733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:45:32.592189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': 'd3b906bc-e412-4bce-b195-2d23d466072d', 'id': '1e928fc4-7a6b-4699-a322-58d655a102b5'} Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.593099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.595449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.596689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) Jun 15 10:45:32.597907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.598974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-353e9720-b463-4512-8af1-9bbdace38fba) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.598974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ea4f0ae-208c-4f96-af82-8c3885f775a0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5" status: 400 len: 269 microversion: 2.1 time: 0.170152 Jun 15 10:45:32.598974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 894/1882] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments/1e928fc4-7a6b-4699-a322-58d655a102b5 => generated 269 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.599976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.600675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.607593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.608139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.608907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.609364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.624649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:32.627733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.629516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.630336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.631425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.632659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.637647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) Jun 15 10:45:32.639101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.640508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63eaae74-6a37-482b-8a33-d9ca1425b939) {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.640508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d124f75-547f-4bcf-a0e3-0cfb4169fc1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.206037 Jun 15 10:45:32.640508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 989/1883] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 269 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.640508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.640855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.643028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.643475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.644237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.644673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.676181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be92f82c-ef78-4499-a656-093dca60ff44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Jun 15 10:45:32.676750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 990/1884] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:32.681163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.681773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.687604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.688049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.688813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.689387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.703276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:32.704804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.707298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.708129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:32.714071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.715494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.715494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3a21be1f-ad79-4013-9fd6-30218e665c3f tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.028563 Jun 15 10:45:32.715494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 991/1885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:32.715494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.715494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.718704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.719149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.719914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.720343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.751603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edeb30c8-322b-4fed-a29f-216ba25e0db4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043697 Jun 15 10:45:32.752180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 992/1886] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:45:32.753669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:32.756919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.757882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.761207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07f27c01-c8a4-417d-bf0b-766b08e29ced tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.167525 Jun 15 10:45:32.761757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 895/1887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:32.763796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.764243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.765111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.765455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.766518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.766998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.776718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.777194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.777959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.778389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.796929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-354dc405-2e51-4185-9635-0b8406638989 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Jun 15 10:45:32.797522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 993/1888] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:32.802679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.803281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.809485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.809931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.810912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.811105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.864897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lazy-loading 'services' on Instance uuid 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:32.924816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Request method failure captured: Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b HTTP/1.1 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbNzVevtKQr4hOWVZmKIjYNxJbWF6k27VCSSWVxvO1spiYfEHS90ca_emOCwhQ1xtDRt5EbzamZLY8ZvReCtP68AZcXvJ0mqHJiuoIWn8cIj5Qpd-PlodwXSm2uLmL4Id-eLT04jE3C-1QwXZavidN7GCmMViVYkgh_N3H0_O62BXX4 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:32.927204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/40cd185858444d8aaf78e72a740b624f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_40cd185858444d8aaf78e72a740b624f", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 40cd185858444d8aaf78e72a740b624f Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457125394 Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 80a318aa610e449fb6e480372ee61db8 Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesSnapshotTestJSON-457125394-project Jun 15 10:45:32.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '3c7caeb5-c9cc-493c-94d7-cac63be29ff2', 'id': '787624eb-7198-440c-9d6e-2b274d11c75b'} Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.929669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:32.930749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.931933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.932991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) Jun 15 10:45:32.934107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:32.935298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e99af60-f487-461e-9c8d-e8d7751c6fa9) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:32.935298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ee0ae21-6a16-4683-b8ae-de9de4b574b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b" status: 400 len: 269 microversion: 2.1 time: 0.166442 Jun 15 10:45:32.935298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 896/1889] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2/os-volume_attachments/787624eb-7198-440c-9d6e-2b274d11c75b => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:32.935298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.935932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.943649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.943649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.944100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.944478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.957302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:32.966490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eb67e5c2-a166-4e0c-bfa6-46c10f3eb6ec tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1561 microversion: 2.1 time: 0.167922 Jun 15 10:45:32.967061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 994/1890] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:32.972911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.973694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.981323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.981763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.982810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.983273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.984740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddadfe98-80da-476c-bc7b-321dbe1cc4b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053926 Jun 15 10:45:32.986008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 897/1891] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:32.993684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.994629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:33.001140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.001583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.002419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.002840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.004952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:33.008399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:33.010275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:33.011257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:33.012724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:33.014397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:33.015403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64a0d590-1854-4a3c-b87f-27da84985b85 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.047226 Jun 15 10:45:33.016070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 995/1892] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:33.034364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:33.034364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:33.039168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.039611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.040377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.040808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.041240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-267ada76-df3a-4fc9-bb6c-25ff5f6fdda4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054631 Jun 15 10:45:33.042045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 898/1893] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:45:33.074759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0af32ce0-5c44-4369-8dcd-1923a2c5cfc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056373 Jun 15 10:45:33.075188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 996/1894] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:33.085050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2094854516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780355668", "security_groups": [{"name": "tempest-secgroup-smoke-1383212853"}], "block_device_mapping_v2": [{"uuid": "2e038b41-174a-43d0-a800-06dba1bfb5cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2e5d567-e18a-49e3-9189-cd1f166f6ba9"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:33.260022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] validate_networks() for [('b2e5d567-e18a-49e3-9189-cd1f166f6ba9', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:45:33.809849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:33.810870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:33.818188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.818710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.819554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.820050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.850642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d4ec8800-9bd6-4e47-83f2-74ec84e46df0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Jun 15 10:45:33.851214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 997/1895] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:33.971173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:45:33.971733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:45:33.972207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:45:33.972610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:45:33.973055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:45:33.982728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.983097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.983882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.984309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.997280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:33.998407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.004443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:45:34.009653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Getting quotas for user 0ac3d9b2893b4f078c2a379696aaff34 and project dedc3b6e0d964cb9937f0a57894554b7. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:45:34.010241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.010714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.011674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.012549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.103918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:45:34.104774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: f27dd57e-8f22-405f-83f3-f4255cb624e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e038b41-174a-43d0-a800-06dba1bfb5cf',volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:45:34.110614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd6a0d44-813a-4832-909c-53fd9309417f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/action" status: 200 len: 41213 microversion: 2.1 time: 0.117498 Jun 15 10:45:34.113226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 998/1896] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:45:33 2022] POST /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479/action => generated 41213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:45:34.119429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:34.120933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.129081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.129536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.130314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.130740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.222953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 478 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:34.226717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:34.231612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {"server": {"name": "tempest-TestVolumeBootPattern-server-2094854516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1780355668", "security_groups": [{"name": "tempest-secgroup-smoke-1383212853"}], "block_device_mapping_v2": [{"uuid": "2e038b41-174a-43d0-a800-06dba1bfb5cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2e5d567-e18a-49e3-9189-cd1f166f6ba9"}]}} Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-2094854516', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-1780355668', 'security_groups': [{'name': 'tempest-secgroup-smoke-1383212853'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '2e038b41-174a-43d0-a800-06dba1bfb5cf'}], 'networks': [{'uuid': 'b2e5d567-e18a-49e3-9189-cd1f166f6ba9'}]}}} Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:34.232239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise self.value Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:34.232937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:45:34.234163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise self.value Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 15 10:45:34.235285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:45:34.238791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise self.value Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:34.241208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:34.242821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 2e038b41-174a-43d0-a800-06dba1bfb5cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ba1f5704-b88c-4e29-bc0d-a26366959823) {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f38db77-7736-48e6-8f63-7cbc342ad1b6 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.148279 Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 899/1897] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:45:33 2022] POST /compute/v2.1/servers => generated 295 bytes in 1150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:45:34.244830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:34.245854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.250674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.250674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.253060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.253060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.256672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d5827fa8-c06a-4cbb-bd45-fe5dc2d05a40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action" status: 200 len: 37505 microversion: 2.20 time: 0.140531 Jun 15 10:45:34.264334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 999/1898] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Jun 15 10:45:34 2022] POST /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc/action => generated 37505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:45:34.290917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f26bd42b-4f4d-4cb0-812a-873f3de2f54c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060826 Jun 15 10:45:34.293055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 900/1899] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:34.347084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:34.347655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.356846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.356846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.356846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.356846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.408899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:45:34.430942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-49c92a16-bfe8-4d93-9534-c426ff732736 req-f691eaa1-519a-4168-ba8b-3a7df091c476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:34.440273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-49c92a16-bfe8-4d93-9534-c426ff732736 req-f691eaa1-519a-4168-ba8b-3a7df091c476 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.441068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-49c92a16-bfe8-4d93-9534-c426ff732736 req-f691eaa1-519a-4168-ba8b-3a7df091c476 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.454497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-49c92a16-bfe8-4d93-9534-c426ff732736 req-f691eaa1-519a-4168-ba8b-3a7df091c476 service nova] Creating event network-changed:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:45:34.461821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-49c92a16-bfe8-4d93-9534-c426ff732736 req-f691eaa1-519a-4168-ba8b-3a7df091c476 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113881 Jun 15 10:45:34.462496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 901/1900] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:34.686807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-11048bee-313e-4d50-960b-8ae74ae30cd2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "DELETE /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 204 len: 0 microversion: 2.1 time: 0.347207 Jun 15 10:45:34.687390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1000/1901] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:45:34 2022] DELETE /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:45:34.697785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:34.698586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.705120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.706109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.706919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.707352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.864878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:34.870895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:34.873536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.873975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.874800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:34.875419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.909503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bfe855f2-830a-46ba-a8e5-3dd55a649c93 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049887 Jun 15 10:45:34.910254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1001/1902] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:34.999332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:35.009246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7eaeabe7-68b8-4daf-bfcf-9edd238c7cf3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1567 microversion: 2.1 time: 0.315923 Jun 15 10:45:35.009973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 902/1903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:35.303267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:35.304589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:35.313026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.313775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.314789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.315697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.337543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:35.354554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-65ae41f2-f179-4717-ba51-8c4a622fb98b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056445 Jun 15 10:45:35.359595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1002/1904] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:35.666220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:35.666809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:35.673591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.674036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.674851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.675292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.689253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:45:35.690955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.692412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:35.693353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.694715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.696175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:35.696175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9fb3556-9e1b-49d7-ba25-6d47d7681836 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.030120 Jun 15 10:45:35.696175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 903/1905] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:45:35 2022] DELETE /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:35.702052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:35.702735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] [instance: 1bd0d535-7284-4990-a7aa-9cb616268d39] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:35.710485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.714115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.714115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.714115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.727253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] HTTP exception thrown: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Request method failure captured: Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 HTTP/1.1 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbOfYs6HyL7OURf37CsiK1WZe8FmgOGdU80mie1f19Z2lvjVDFc3KQI5C9sxh7J4kQ09tpgvz4WO8FBiAv6nzIq64x8qW43rx2N-NPD2wg7mjglrLVHcNi9dd8fxCuEeXd1fW88-20Gqr39KMDuEbqjtpuTonKMuVPmPmU9gwNLZWA0 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:45:35.728901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/dedc3b6e0d964cb9937f0a57894554b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_dedc3b6e0d964cb9937f0a57894554b7", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: dedc3b6e0d964cb9937f0a57894554b7 Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestVolumeBootPattern-1319200504 Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 0ac3d9b2893b4f078c2a379696aaff34 Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestVolumeBootPattern-1319200504-project Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.730460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '1bd0d535-7284-4990-a7aa-9cb616268d39'} Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:35.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. Jun 15 10:45:35.733145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:45:35.735000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Returning 404 to user: Instance 1bd0d535-7284-4990-a7aa-9cb616268d39 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:35.735000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a17fb152-9bf9-4e38-a76a-2df9dc7f0ff2 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39" status: 404 len: 111 microversion: 2.1 time: 0.032632 Jun 15 10:45:35.735000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1003/1906] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:35 2022] GET /compute/v2.1/servers/1bd0d535-7284-4990-a7aa-9cb616268d39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:45:35.921545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:35.922449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:35.930085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.930573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.931399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.931902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.964926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4db003c-0afc-4960-ac7f-02fed0116c2e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Jun 15 10:45:35.965548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 904/1907] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:36.039094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:36.039094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:36.039094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.039094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.040119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.040827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.112613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:36.120590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-448b87f1-e978-4125-9a99-f85f73467e95 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1382 microversion: 2.1 time: 0.096619 Jun 15 10:45:36.121553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1004/1908] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1382 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:36.366611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:36.367463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:36.373520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.375823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.375823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.375823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.404562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-76a7d17a-82a4-4057-8723-bb431a4b2190 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Jun 15 10:45:36.405112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 905/1909] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:36.759053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-d898fd81-e3a4-4769-a494-0192e680162f req-78ab8641-34a9-4675-96d3-84da746aadf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900487d3-db1b-4eee-8345-bdbe9e61a352", "name": "network-vif-deleted", "tag": "ed07afb0-86df-47d9-8c11-8a4c4fd61342"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:36.768309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d898fd81-e3a4-4769-a494-0192e680162f req-78ab8641-34a9-4675-96d3-84da746aadf7 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.768752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d898fd81-e3a4-4769-a494-0192e680162f req-78ab8641-34a9-4675-96d3-84da746aadf7 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.779578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-d898fd81-e3a4-4769-a494-0192e680162f req-78ab8641-34a9-4675-96d3-84da746aadf7 service nova] Creating event network-vif-deleted:ed07afb0-86df-47d9-8c11-8a4c4fd61342 for instance 900487d3-db1b-4eee-8345-bdbe9e61a352 on hv-cinder-84580 Jun 15 10:45:36.784679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-d898fd81-e3a4-4769-a494-0192e680162f req-78ab8641-34a9-4675-96d3-84da746aadf7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029217 Jun 15 10:45:36.785295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1005/1910] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:36.978772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:36.979680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:36.986640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.987086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.987853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.988286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.013428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:37.017891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b3adceb-fdd4-49e1-b9b4-01724e22c942 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Jun 15 10:45:37.018610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 906/1911] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:37.139659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:37.140353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:37.146972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.147419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.148178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.148607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.210790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:37.218748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10770c59-bb86-4267-9150-1b563213288f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083332 Jun 15 10:45:37.219310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1006/1912] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:37.416299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:37.417162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:37.423510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.424685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.425479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.425911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.454916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5f6f9c3-476c-4fe3-80e4-fb204a28b240 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Jun 15 10:45:37.455542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 907/1913] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:38.031668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:38.032581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:38.039147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.039594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.040355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.040786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.069223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-15c958b5-9ea6-4fc8-8089-6114a449cd8c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Jun 15 10:45:38.069776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1007/1914] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:38.235592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:38.236882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:38.243349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.243783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.244859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.245315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.307399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:38.315165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04fa2219-4bf1-44ab-b24d-732797f96392 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083352 Jun 15 10:45:38.315952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 908/1915] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:38.466429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:38.467477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:38.474600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.475040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.475807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:38.476414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:38.506728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-376e58d6-61af-42b6-86e2-004e878c83e8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Jun 15 10:45:38.507304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1008/1916] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:39.081607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:39.082531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:39.088602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.089079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.090099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.090536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.120021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfd29fe5-4653-471c-971b-19854cc66be3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042886 Jun 15 10:45:39.120572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 909/1917] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:39.341149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:39.341716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:39.348547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.349019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.349806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.350233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.414822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:39.422538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c32eaf2-488b-4f20-8617-4d0ec89dda11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085637 Jun 15 10:45:39.423095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1009/1918] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:39.518380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:39.519293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:39.525937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.526401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.527132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:39.527572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:39.559070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29bc6eb0-4f16-4663-83c1-d1ede32724ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Jun 15 10:45:39.559630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 910/1919] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:40.131836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:40.132745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:40.138801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.139247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.140017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.140446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.171018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79e9705f-405b-4693-88bd-cb5dae43c885 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Jun 15 10:45:40.171576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1010/1920] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:40.439676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:40.440278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:40.447289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.447731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.448518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.448947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.511111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:40.519665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7a6ebbf2-414e-46c8-aa7b-65e9406a6eda tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083879 Jun 15 10:45:40.520217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 911/1921] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:40.570798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:40.571718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:40.578277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.578751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.579513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.580665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.611779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7c8a579a-51e1-42a6-aa0d-499c32ccf242 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Jun 15 10:45:40.612329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1011/1922] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:41.182799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:41.183720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:41.190413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.190853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.191617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.192054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.223127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c875345-d0be-4776-a1b3-13b41b86b582 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jun 15 10:45:41.223704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 912/1923] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:41.537303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:41.537913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:41.544299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.544742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.545584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.546012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.608282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:41.616671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-283a8759-c457-4581-8a08-5ed322d0871f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083868 Jun 15 10:45:41.617258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1012/1924] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:41.622230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:41.623172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:41.629453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.629904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.630666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.631097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.661259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33ca90de-c584-4306-a974-42ea0dc3d352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Jun 15 10:45:41.661812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 913/1925] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:42.234216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:42.235170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:42.241870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.242328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.243092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.243528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.274484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe8ca7a6-dcc4-4f59-845b-5ef34fe928b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044298 Jun 15 10:45:42.275046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1013/1926] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:42.633695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:42.634337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:42.637911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:42.641338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.641784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.642545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.642978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.673198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:42.675000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:42.681751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.686024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.686024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:42.686024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.709439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:42.717787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e29115a2-9019-4c65-ac89-1436d8354a11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087897 Jun 15 10:45:42.718539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 914/1927] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:42.722267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-43bcf0a0-95ed-4f78-972e-6862725c3855 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053000 Jun 15 10:45:42.722832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1014/1928] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:43.286628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:43.287550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:43.293787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.294232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.295004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.295442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.326536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1cbbc25d-309c-4c9b-882a-4159882a7879 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Jun 15 10:45:43.332699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 915/1929] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:43.736781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:43.737400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:43.741229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:43.742167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:43.744267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.744723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.745520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.745958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.748599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.749075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.749938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.750372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.782147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12b1b9fd-f0b5-47de-8272-82819bbbfe17 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Jun 15 10:45:43.782766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 916/1930] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:43.807625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:43.816322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-12d1d815-65ae-4df9-8fc6-0db263f533cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083499 Jun 15 10:45:43.816895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1015/1931] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:44.339097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.340270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.342111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:44.342785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=6 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:44.348693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.349228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.349994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.350425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.381646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d37b014-ee1a-4f2c-8d49-5d1385f90f9c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Jun 15 10:45:44.382199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 917/1932] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:44.793762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.794787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.799526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:44.803006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.803447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.804203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.804659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.833210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.833914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.836461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48b32f14-deb4-4fe8-8910-dc47f608ddb7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Jun 15 10:45:44.837352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1016/1933] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:44.841346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.841786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.842544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.842973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.904335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:44.912079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99d8cd0f-7328-4030-9cf1-c693c6b236f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083115 Jun 15 10:45:44.912640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 918/1934] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:45:45.393496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:45.394408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:45.401122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.401564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:45.402329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.402753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:45.435111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bda66c84-ebf7-4644-ad97-45d9615214f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Jun 15 10:45:45.435597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1017/1935] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:45.849629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:45.850571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:45.857131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.857574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:45.858328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.858751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:45.889746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-346b8a9f-56ca-46f5-b239-cee022fc95e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Jun 15 10:45:45.890305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 919/1936] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:45.929739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:45.930342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:45.936818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.937291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:45.938042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:45.938473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:46.005839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:46.013349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77becb92-c2ff-42b7-ba22-b59e78cf31e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087630 Jun 15 10:45:46.013900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1018/1937] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:46.446760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:46.447675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:46.454097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:46.454596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:46.455666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:46.456104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:46.488432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d929d584-5f41-472f-968e-1fe7e9581ee8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045730 Jun 15 10:45:46.489023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 920/1938] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:46.903604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:46.904442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:46.911365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:46.911812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:46.912577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:46.913038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:46.945801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-40462d89-a177-46f6-828c-1fb2ff7f8b3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Jun 15 10:45:46.946527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1019/1939] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:47.030620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:47.031380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:47.038717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.039264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.040095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.040528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.124071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:47.132123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-baa5a125-4a2f-479c-b350-0799690cd0b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.105221 Jun 15 10:45:47.136938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 921/1940] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:47.500222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:47.501174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:47.508124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.508563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.509357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.509787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.527413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:47.540444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2cef1eb1-73e0-44fa-8d39-65df46b73cd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Jun 15 10:45:47.541236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1020/1941] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:47.957573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:47.958511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:47.964869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.965343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.966102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:47.966537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:47.995757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa01449d-7b23-42ed-b74e-7f12571c2080 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Jun 15 10:45:47.996299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 922/1942] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:48.153065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:48.153672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:48.160312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:48.160763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:48.161552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:48.161984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:48.227264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:48.234897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-660ec7ff-008d-426f-a143-61410bac168a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086057 Jun 15 10:45:48.235462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1021/1943] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:48.552877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:48.553843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:48.560565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:48.561042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:48.561804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:48.562239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:48.580207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:48.592825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5776443e-5933-44d5-b22e-02e213240280 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jun 15 10:45:48.595054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 923/1944] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:49.007562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:49.008499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:49.014616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.015049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.015791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.016217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.046108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be1cc7d7-7c25-4c0d-8352-ee5e28083b95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jun 15 10:45:49.046796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1022/1945] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:49.251854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:49.252528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:49.259221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.259602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.260388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.260828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.322677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:49.330901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6db83f24-4ca1-44e4-9bc8-12da231571cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083034 Jun 15 10:45:49.338982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 924/1946] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:49.604698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:49.605650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:49.612314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.612755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.613531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:49.613980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:49.643754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e8a7f299-2c18-4513-86b7-9a71fdfaafc6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Jun 15 10:45:49.644297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1023/1947] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:50.058862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:50.059779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:50.066897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.067360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.068118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.068540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.102145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-95ae3a5f-3971-4a75-981c-55e2c12e3b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047171 Jun 15 10:45:50.102709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 925/1948] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:50.348523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:50.349079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:50.356030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.356471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.357249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.357679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.418445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:50.426316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f51837ae-9457-49d6-94a1-79d731e80a3c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081874 Jun 15 10:45:50.426867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1024/1949] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:50.655334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:50.656170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:50.662788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.663226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.663991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:50.664430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:50.695851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ca86a38-199c-4901-b692-ee9794d5ad5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Jun 15 10:45:50.696418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 926/1950] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:51.115228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:51.116289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:51.122997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.123435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.124210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.124636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.155920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ab668db-8981-49e5-a960-d90c90348588 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Jun 15 10:45:51.156497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1025/1951] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:51.443474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:51.444042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:51.450537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.450983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.451748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.452177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.518629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:51.526623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47662103-e29c-4fa1-b434-cd35ae0fefac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087149 Jun 15 10:45:51.527202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 927/1952] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:51.709491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:51.710567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:51.717131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.717579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.718379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:51.718832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:51.750927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4efd4f14-7e09-4839-a2d0-574200fea952 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Jun 15 10:45:51.751716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1026/1953] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:52.169472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:52.170395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:52.176886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.177365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.178136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.178570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.210534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c1bb9ef-8329-4766-89ce-98078ab0513a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Jun 15 10:45:52.211112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 928/1954] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:52.545943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:52.546550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:52.554332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.554774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.555534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.555963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.622046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:52.630933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f97818a2-2749-4bf2-a7be-39ce2abfa655 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088869 Jun 15 10:45:52.631506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1027/1955] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:52.762805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:52.763710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:52.770955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.771396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.772161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:52.772595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:52.805297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14d0127f-7c34-4598-8446-668921217f86 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Jun 15 10:45:52.805782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 929/1956] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:53.223125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:53.224068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:53.230340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.230785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.231556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.231993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.262085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a25777ce-148d-488f-8544-fc0caa05698b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043708 Jun 15 10:45:53.262624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1028/1957] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:53.648876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:53.649507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:53.655532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.655972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.656718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.657271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.718524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:53.726133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5616b22-03f4-4869-a6ce-e1b61ba3d948 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081153 Jun 15 10:45:53.726691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 930/1958] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:53.817439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:53.818350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:53.825076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.825521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.826290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:53.826724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:53.856471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e033605e-358e-43ea-b820-9940466cca57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Jun 15 10:45:53.857033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1029/1959] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:54.274081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:54.275001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:54.282047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.283157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.284029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.284459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.314996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-235f5cd4-4956-4c62-9be8-292ca6bbf304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Jun 15 10:45:54.315542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 931/1960] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:54.742538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:54.743148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:54.749394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.749841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.750607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.751041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.815639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:54.824038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6fee5bad-503b-4ea5-a737-9113d24b464d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085305 Jun 15 10:45:54.825341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1030/1961] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:54.868135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:54.869067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:54.876017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.877165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.877948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:54.878373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:54.909353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7c05bcf-f8c4-487e-9b73-06a6748297ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Jun 15 10:45:54.909920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 932/1962] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:55.327706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:55.328669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:55.335798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.336310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.337131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.337559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.370437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7fe63d6b-e4ba-42eb-bd81-06821fae3fc1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047819 Jun 15 10:45:55.371031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1031/1963] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:55.842045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:55.842616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:55.849454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.849893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.850645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.851070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.913064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:55.919937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:55.920848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:55.922678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1b2e5be-19e2-481f-a4a9-4e29806f0991 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084835 Jun 15 10:45:55.924286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 933/1964] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:55.928135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.928577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.929375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:55.929805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:55.960430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5435659-f90b-4e8b-ac2a-c58e97e0fa55 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Jun 15 10:45:55.961005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1032/1965] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:56.383381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:56.384297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:56.390330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.390779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:56.391541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.392593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:56.423238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc9ca7a8-7a55-4c7b-880c-114fa8f0ea01 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Jun 15 10:45:56.423808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 934/1966] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:56.941820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:56.942441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:56.949126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.949566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:56.950319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.950742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:56.972130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:56.973088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:56.979465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.979907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:56.980659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:56.981110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:57.015329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c19f8073-e32f-47fc-a80c-8b8bff9839f2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Jun 15 10:45:57.017804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 935/1967] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:57.018920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:57.026734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4098b3a8-8a17-4661-baa6-72a26740facf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089997 Jun 15 10:45:57.027300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1033/1968] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:57.435179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:57.436095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:57.442641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:57.443082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:57.443849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:57.444279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:57.475300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ff4d96bc-a423-478f-92e9-253254652bef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Jun 15 10:45:57.475871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 936/1969] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:58.150750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:58.150750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:58.150750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.150750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.152136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.152136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.152393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:58.152393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:58.152393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.152393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.153199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.153199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.153439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69dda0da-cd4e-4cc1-8e08-0bb816198c0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061218 Jun 15 10:45:58.153439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1034/1970] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:58.153690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:58.153690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5e930147-f6cb-4dbf-8a33-f0e7613a355e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.098352 Jun 15 10:45:58.153690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 937/1971] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:58.487401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:58.488311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:58.495450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.495900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.496670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:58.497141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:58.530261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29577ccb-f5c3-4314-881e-bb5c94ab4846 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046752 Jun 15 10:45:58.530858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1035/1972] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:59.103625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:59.105326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:59.115086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.115613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.116403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.116850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.148467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c01d3d1-ca23-42fb-a01f-b12af313ec7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051236 Jun 15 10:45:59.149089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 938/1973] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:59.155622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:59.156318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:59.164028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.164468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.165284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.165719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.232618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:59.243550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-02788e36-f1f6-4576-9398-24eacf4bdd5a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091546 Jun 15 10:45:59.244906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1036/1974] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:45:59.542760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:59.543151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:59.550058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.550499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.551254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:59.551681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:59.582953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5cd65bd8-921a-4965-ad56-8df00bf0c14c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Jun 15 10:45:59.583499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 939/1975] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:45:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:00.162007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:00.162924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:00.169754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.170193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.170975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.171397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.176785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:00.205049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-365c3142-753c-4da0-a05f-b2b7e7f2a30a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047360 Jun 15 10:46:00.205748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1037/1976] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:00.270365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:00.270992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:00.277872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.278353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.279139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.279577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.284731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:00.348370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:00.362353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0bab77c6-b187-4f34-ac5d-c58610f7216b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090688 Jun 15 10:46:00.363509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 940/1977] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:00.594623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:00.596215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:00.602845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.603287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.604053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:00.604487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:00.637734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e3a0538-1a3e-4e29-aea8-3fc4d43dc35f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046997 Jun 15 10:46:00.638292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1038/1978] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:01.217447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:01.218375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:01.224676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.225158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.225928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.226367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.257295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6c99faf-56c1-4709-91f9-139944346893 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Jun 15 10:46:01.257871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 941/1979] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:01.381032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:01.381832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:01.388145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.388585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.389396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.389829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.453589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:01.461331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dba302fe-0584-477c-a0ae-e3076d4341ee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085212 Jun 15 10:46:01.461891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1039/1980] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:01.651235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:01.652436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:01.660455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.660897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.661711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:01.662147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:01.693745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82218454-76d1-4d3e-8d69-52e0f276e0ab tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048302 Jun 15 10:46:01.694310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 942/1981] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:02.269231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:02.270162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:02.276286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.276734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.277526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.277960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.307762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-999bb711-3aef-4cf6-8d6a-5d73f9e80e64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Jun 15 10:46:02.308316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1040/1982] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:02.479758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:02.480368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:02.487265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.487707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.488489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.488898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.552057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:02.560773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b6178c5-a83a-4d0a-89b1-31c157788a2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085145 Jun 15 10:46:02.561400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 943/1983] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:02.706265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:02.707414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:02.715244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.715688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.716503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:02.716919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:02.753109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b4327fe-565d-4b17-9b87-b3facd2d6cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051053 Jun 15 10:46:02.753697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1041/1984] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:03.320140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:03.321338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:03.330957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.331396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.332177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.332606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.375179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c8afdae-7ed2-4802-ba93-5c86d94f9514 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059099 Jun 15 10:46:03.375997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 944/1985] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:03.578519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:03.579613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:03.585853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.586291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.587092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.587520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.653756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:03.663261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2158adfd-5e65-4be0-978c-faaeacab380e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088871 Jun 15 10:46:03.663833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1042/1986] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:03.764969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:03.765952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:03.773049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.773719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.774277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:03.774782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:03.806647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b4f558e-f556-49ad-b02c-d1553f85c1ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Jun 15 10:46:03.807227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 945/1987] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:04.390208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:04.391286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:04.399129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.399577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.400350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.400777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.433932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a286b9b-8240-4921-90ee-4db6645e9460 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047749 Jun 15 10:46:04.434537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1043/1988] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:04.681212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:04.681735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:04.689035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.689718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.690527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.690958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.758463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:04.767488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a799d079-4dc1-4c3d-9720-b35274dfbb91 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089624 Jun 15 10:46:04.768215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 946/1989] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:04.818556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:04.819711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:04.826481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.826997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.827818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:04.828296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:04.862399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d254e4b6-0369-46d8-8310-98ddd228b3ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047854 Jun 15 10:46:04.862969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1044/1990] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:05.446616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:05.447453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:05.453978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.454423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.455203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.455634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.490405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-777d6f67-2ea9-40eb-8874-7146ada0ff83 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047839 Jun 15 10:46:05.490991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 947/1991] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:05.785243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:05.785901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:05.793247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.793547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.794233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.794670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.865208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:05.877359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:05.878417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4065b3cd-6d13-4288-8dc0-9824a9dbf979 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.097066 Jun 15 10:46:05.879086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:05.879395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1045/1992] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:05.891156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.892455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.894178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:05.894977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:05.930874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-845b9aa7-aad2-4a8b-a465-a90a72ea96b7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060443 Jun 15 10:46:05.931452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 948/1993] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:06.504599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:06.505747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:06.515289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.515743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.517072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.518010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.554215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69645b12-1397-438f-8f06-b31e679a8d02 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055120 Jun 15 10:46:06.554798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1046/1994] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:06.903922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:06.904532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:06.911355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.911797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.912562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.913011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.943427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:06.944405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:06.951169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.951617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.952405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:06.952849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:06.986842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa13ac28-8a03-43df-9380-2a6fd4e8abce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047379 Jun 15 10:46:06.987873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1047/1995] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:07.013715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:07.023580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac839df9-00ae-4e42-9537-adbc07c84bdc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.123277 Jun 15 10:46:07.024251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 949/1996] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:07.566639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:07.567556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:07.573808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:07.574264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:07.575025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:07.575448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:07.608452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c90fdad-ba61-4923-826e-09718f4ad030 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 Jun 15 10:46:07.609051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1048/1997] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:08.000420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:08.001496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:08.009573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.010019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.010798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.011243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.046149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21b9fbff-e580-41fd-9ede-77edd2c38232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049903 Jun 15 10:46:08.046769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 950/1998] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:08.048161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:08.054679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:08.060473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.060932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.062058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.062553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.134211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:08.143447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c599649a-d78d-494b-890a-9532641d5b0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.101514 Jun 15 10:46:08.144051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1049/1999] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:08.620779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:08.621845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:08.629494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.629945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.630735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:08.631167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:08.664732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d1639c3-6aa4-4a64-ade4-bccd5dac2f0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Jun 15 10:46:08.665374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 951/2000] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:09.064585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:09.065542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:09.072117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.072563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.073347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.073783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.104273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ad63a24-1b51-43fb-a141-842e445e47e2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Jun 15 10:46:09.104834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1050/2001] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:09.162904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:09.163517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:09.170159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.170596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.171378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.171804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.241181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:09.249290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-74e4c90a-db02-4037-b8fb-b4f9dc6ef76f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090071 Jun 15 10:46:09.249864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 952/2002] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:09.676934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:09.677785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:09.683883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.684318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.685101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:09.685536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:09.721768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e79acde-c191-4210-975f-d77f15712fd2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049865 Jun 15 10:46:09.722363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1051/2003] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:10.116860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:10.117825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:10.123928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.124369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.125362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.125798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.156288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ada5666-89bb-438a-93ac-7e757c802d60 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Jun 15 10:46:10.157346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 953/2004] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:10.268748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:10.269391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:10.276402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.276831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.277633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.278061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.343705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:10.352757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1200fc0c-f157-47e7-aeac-fd97f1c50fad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089224 Jun 15 10:46:10.353352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1052/2005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:10.733058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:10.734005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:10.740601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.741077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.741858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:10.742317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:10.778627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7194eb96-7cec-45b0-9478-2e6e1ff81246 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049519 Jun 15 10:46:10.779216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 954/2006] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:10.783213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:46:10.783400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:46:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:46:11.168970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:11.170251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:11.180920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.181720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.183041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.183802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.210692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:11.215323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f12a116-5da9-4fb6-b094-70e238d22101 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050482 Jun 15 10:46:11.215869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1053/2007] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:11.370792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:11.371414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:11.378499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.378944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.379749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.380183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.443184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:11.450749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a62719fb-bce2-4bbf-a382-9f4f987bbdf9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083890 Jun 15 10:46:11.451306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 955/2008] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:11.791121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:11.792030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:11.800191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.800630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.801410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:11.801836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:11.833595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-993de6f6-d660-4351-8886-96019e806ee9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Jun 15 10:46:11.834157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1054/2009] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:12.229465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:12.230387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:12.237766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.238210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.238979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.239410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.265414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:12.270393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24e11dcb-d1a0-4404-b18e-5cd8c82fab2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Jun 15 10:46:12.270965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 956/2010] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:12.470284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:12.471055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:12.477231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.477671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.478426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.478853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.543615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:12.552345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3e43d52-3653-4689-a904-28757e228016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086782 Jun 15 10:46:12.552942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1055/2011] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:12.846109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:12.847629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:12.849508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=85 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:12.854436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.854880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.855637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:12.856067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:12.887181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9510fe4-5c91-4be3-834d-9ef9a6b8937f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Jun 15 10:46:12.887739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 957/2012] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:12 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:13.282243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:13.282951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:13.289825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.290275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.291056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.291486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.327177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3fac94a5-5697-496f-b5e5-fd21e1e402e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049446 Jun 15 10:46:13.327783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1056/2013] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:13.570305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:13.571282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:13.577838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.578285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.579775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.580217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.650766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:13.659544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0fcd135-0b85-4d9b-91e8-f28f06f7d911 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.093441 Jun 15 10:46:13.660131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 958/2014] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:13.899354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:13.900281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:13.909116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.909392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.910152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:13.910607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:13.948535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-320e238a-2f50-4d9d-93f7-a0aa348e3ead tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053175 Jun 15 10:46:13.949459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1057/2015] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:14.339718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:14.340906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:14.350144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.350668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:14.351468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.352252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:14.386465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f262efc-4b8f-4fb4-bf5f-e8da350bad16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050375 Jun 15 10:46:14.386465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 959/2016] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:14.685081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:14.685632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:14.692162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.692607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:14.693408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.693839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:14.762714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:14.771395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ceb67932-cdfc-4742-aa17-6b7534faff48 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090183 Jun 15 10:46:14.771986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1058/2017] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:14.961311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:14.962220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:14.969034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.969524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:14.970481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:14.970913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:15.001216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6dc80233-a06d-405c-ab2e-88b96f0c08c4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Jun 15 10:46:15.002041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 960/2018] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:15.397978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:15.398848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:15.405182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:15.405632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:15.406386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:15.406853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:15.436512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92054558-2706-454c-b02c-97fc4ed6bc69 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042596 Jun 15 10:46:15.437146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1059/2019] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:15.789052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:15.789670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:15.795883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:15.796329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:15.797117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:15.798305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:15.858953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:15.866452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8142927a-8f25-4604-b72c-da4d62dc1d41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081465 Jun 15 10:46:15.867047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 961/2020] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:16.013324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:16.014243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:16.016883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=87 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:16.021777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.022223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.022985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.023415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.054797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-242d93d1-cb8c-40e5-9418-a058faadf518 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Jun 15 10:46:16.055283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1060/2021] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:16.448349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:16.450380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:16.455981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.456421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.457320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.457860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.488854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-17cc9f9e-4e82-4476-8fa0-737bff07070c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044519 Jun 15 10:46:16.489432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 962/2022] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:16.883631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:16.884240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:16.890610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.891084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.893567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:16.894004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:16.955580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:16.963199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-693b6539-03cb-4787-aa4b-a70b75ffd78b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083550 Jun 15 10:46:16.963757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1061/2023] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:17.066017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:17.066935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:17.073156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.073597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:17.074346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.074771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:17.109030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a47c3b3-2403-4444-b575-2793d7bacfd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046964 Jun 15 10:46:17.109614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 963/2024] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:17.500645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:17.501997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:17.509757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.510236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:17.510996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.511429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:17.542615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0191f770-687d-4b79-af26-64ed43ec03a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Jun 15 10:46:17.542898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1062/2025] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:17.980988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:17.981686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:17.988472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.988905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:17.989686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:17.990114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:18.058126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:18.066242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18be477c-0d80-4f7e-a1eb-6660cf9d8511 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089061 Jun 15 10:46:18.066792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 964/2026] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:18.120330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:18.121265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:18.127616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:18.128057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:18.128806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:18.129333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:18.160034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6091577a-55f5-40bf-a022-f9667ad56a75 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Jun 15 10:46:18.160586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1063/2027] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:18.554826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:18.555816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:18.561954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:18.564501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:18.564501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:18.564693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:18.594261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aac70752-7bc3-4d8e-b424-608674ed564b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Jun 15 10:46:18.594975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 965/2028] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:19.083306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:19.083905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:19.090824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.091266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.092018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.092447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.155650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:19.163928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-907e937e-55b5-4fe5-8062-533e5eeb7e90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084478 Jun 15 10:46:19.164487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1064/2029] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:19.170761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:19.171677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:19.179113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.179561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.180325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.180756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.210226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddb21316-3861-4714-b467-3bb87dd89455 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Jun 15 10:46:19.215578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 966/2030] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:19.606435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:19.607452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:19.613832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.614272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.615034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:19.615465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:19.644075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cdeb9e33-38a0-4580-9a3b-481bd04000b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 Jun 15 10:46:19.644620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1065/2031] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:20.181543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:20.182132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:20.190008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.190617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.191382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.191813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.226152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:20.227064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:20.233758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.234195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.236243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.236688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.264201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:20.272170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b05fd0e-694a-4a0b-9440-afab9e51a016 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.094445 Jun 15 10:46:20.272749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 967/2032] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:20.274671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c549bcc-24d8-409f-a64e-b0a27f283d28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051493 Jun 15 10:46:20.274671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1066/2033] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:20.656257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:20.657814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:20.663940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.664381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.665171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:20.665594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:20.696547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-be3d9db6-b4d7-45b4-8f96-f89bc7d6d96c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Jun 15 10:46:20.697139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 968/2034] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:21.286821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:21.287879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:21.289483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:21.290817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:21.294573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.295023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.295782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.296331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.298137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.298777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.299543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.299970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.326127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df27bf86-b509-47d3-a8b5-9f8f7241e35d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jun 15 10:46:21.326695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1067/2035] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:21.362239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:21.370072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92e2782f-cd2c-4345-a904-d1a3cc30a973 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084347 Jun 15 10:46:21.370644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 969/2036] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:21.708611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:21.709595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:21.715889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.716335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.717120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:21.717582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:21.747084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8ff0c899-3c0b-481b-970c-8dacf7529f9f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042430 Jun 15 10:46:21.747663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1068/2037] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:22.338363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:22.339286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:22.347715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.348165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.348947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.349449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.380171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13a1b2e7-4f1e-4054-9e65-db3dc8a09669 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Jun 15 10:46:22.380748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 970/2038] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:22.387072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:22.387686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:22.395059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.395509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.396276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.396714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.458584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:22.466747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a0a3837-26c7-48aa-8523-4ed305fe66ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083354 Jun 15 10:46:22.467342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1069/2039] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:22.759776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:22.760723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:22.767550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.767994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.768762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:22.769222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:22.799661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-08e2c4fb-c6e0-4f60-9a26-fa6ac7feead5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jun 15 10:46:22.800227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 971/2040] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:23.392678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:23.393650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:23.400508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.400973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.401751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.402185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.421368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:23.434746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88108e29-0874-4426-afa4-b1046a374fcc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Jun 15 10:46:23.435238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1070/2041] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:23.483837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:23.484494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:23.491826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.492270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.493064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.493500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.560901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:23.569375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b47e2316-c212-4eba-b033-c0555acf7cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089119 Jun 15 10:46:23.572126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 972/2042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:23.811962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:23.813122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:23.820761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.821145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.821913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:23.822712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:23.855718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3bcff584-832b-43e0-b811-c5214ca3379f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 Jun 15 10:46:23.856290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1071/2043] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:24.446492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:24.447471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:24.455036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.455481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.456267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.456707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.476491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:24.491639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ebd8d4dc-dc65-43ca-9fda-ab97cfb5583f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049077 Jun 15 10:46:24.492381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 973/2044] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:24.588059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:24.588840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:24.596987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.597439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.598219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.598713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.667927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:24.676096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7282f999-7c05-41c2-9f38-60e97d85596c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.093076 Jun 15 10:46:24.676682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1072/2045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:24.868293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:24.869233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:24.876124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.876565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.877376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:24.877812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:24.914220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2d1d6b7-8ad0-418c-ac48-c7cee7b2d7ef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050406 Jun 15 10:46:24.914798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 974/2046] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:25.503191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:25.504124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:25.510548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.510994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.511767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.512199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.544245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6633610d-459e-4c6e-9da0-68b9a2067800 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Jun 15 10:46:25.544813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1073/2047] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:25.693519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:25.694126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:25.700205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.700649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.701439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.701869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.768100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:25.775675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c645f5f-7387-48da-a539-2a52620f6196 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086266 Jun 15 10:46:25.776232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 975/2048] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:25.926864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:25.927772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:25.934327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.934764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.935508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:25.935932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:25.970887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78440f65-73bc-475f-8a81-d0c3e798450b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047119 Jun 15 10:46:25.971473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1074/2049] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:26.555929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:26.556882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:26.566470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.566926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:26.567716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.568150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:26.599052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-761e1472-8b42-4933-b9f9-bfba2b415ed5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047028 Jun 15 10:46:26.599627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 976/2050] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:26.793507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:26.794030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:26.800729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.801485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:26.802275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.802709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:26.871315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:26.879393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-441d3c6d-0a98-405d-8cde-674ad060d777 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089762 Jun 15 10:46:26.879973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1075/2051] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:26.981724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:26.982653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:26.990158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.990599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:26.991363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:26.991790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:27.022841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca76c9fa-75ea-4524-aba2-f4f7fe0562b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Jun 15 10:46:27.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 977/2052] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:27.611826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:27.612789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:27.619005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:27.619452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:27.620254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:27.620695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:27.651758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-286b31a0-942a-4f8b-90da-c42649c136cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Jun 15 10:46:27.652316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1076/2053] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:27.897294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:27.897824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:27.904272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:27.904707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:27.905510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:27.905947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:27.967412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:27.976049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a5556e16-de76-4ae4-9ea3-dae66cee91fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082829 Jun 15 10:46:27.976614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 978/2054] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:28.035528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:28.036058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:28.042084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:28.042526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:28.043281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:28.043710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:28.073919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-01745e26-a60b-40c9-bda4-752ddedc05dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Jun 15 10:46:28.074469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1077/2055] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:28.664093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:28.665034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:28.671311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:28.671756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:28.673290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:28.673720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:28.702580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b7bface-a90a-469b-94e0-2689044320a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Jun 15 10:46:28.703156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 979/2056] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:28.993887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:28.994525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:29.001146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.001586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.002329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.002753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.072863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:29.072863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37eeeb06-2f6f-464a-b2e7-782a32ee6c9f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081804 Jun 15 10:46:29.072863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1078/2057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:29.085292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:29.086236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:29.093260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.093799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.095306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.095748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.124393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3249891e-1573-4a39-b1e9-b694a140b665 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043044 Jun 15 10:46:29.124946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 980/2058] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:29.715071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:29.715999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:29.722598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.723051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.723830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:29.724267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:29.756162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b04b97a5-0da6-4e56-89e4-f20f70ed9e33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Jun 15 10:46:29.756740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1079/2059] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:30.089925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:30.090518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:30.098117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.098557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.099328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.099760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.135311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:30.136248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:30.143384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.143834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.144612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.145078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.164742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:30.173081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-110226ce-5ecc-4e1b-bb15-d0b6de82c3d7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087230 Jun 15 10:46:30.173656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 981/2060] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:30.177448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1991bc15-724a-456c-975b-ef1df5653eba tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Jun 15 10:46:30.178030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1080/2061] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:30.768702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:30.769667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:30.775984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.776428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.777338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:30.777771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:30.810740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5aaf4a37-993e-42ca-8283-b78355fce811 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Jun 15 10:46:30.811213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 982/2062] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:31.189740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:31.190304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:31.190779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:31.191183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:31.197546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.197991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.198799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.198971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.199226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.199395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.200091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.200563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.235881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bfec40c6-82d6-4ce8-bbcd-173a1ae84d7a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050882 Jun 15 10:46:31.236726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1081/2063] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:31.272916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:31.283215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6a9f7f22-98fa-4691-914a-e9c4219409a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.097765 Jun 15 10:46:31.283802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 983/2064] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:31.823288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:31.824134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:31.830793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.831240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.832043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:31.832474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:31.865211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3dae9ab-1ba6-447f-a085-a134df3944d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Jun 15 10:46:31.865780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1082/2065] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:31 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:32.248883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:32.250232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:32.257501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.257966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.258748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.259181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.288972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59e102b8-8720-4485-9599-5de040cd0207 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Jun 15 10:46:32.289566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 984/2066] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:32.300272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:32.300877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:32.307667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.308107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.308992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.309428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.373612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:32.382282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69743e06-d100-4307-b44f-939efa7a14ad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086301 Jun 15 10:46:32.382846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1083/2067] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:32.877282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:32.878117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:32.884352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.884788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.885575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:32.886004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:32.916677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df840411-6db7-47ee-ba27-cc73b43b1794 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Jun 15 10:46:32.917265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 985/2068] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:33.300990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:33.301919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:33.308600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.309077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.309827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.310259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.343865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a09e8bb5-3a0a-4829-8d1f-934caa5c2012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Jun 15 10:46:33.345106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1084/2069] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:33.400547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:33.401184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:33.407782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.408234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.409031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.409469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.473038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:33.480622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2bacd1b4-80bb-4aba-b195-3ecb466f8297 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083945 Jun 15 10:46:33.481216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 986/2070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:33.928891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:33.929731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:33.935754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.936198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.936981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:33.937994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:33.966809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fd207b0e-05b7-4ee6-886b-5ca3fab0ea6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041871 Jun 15 10:46:33.967363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1085/2071] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:34.356219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:34.357217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:34.363937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.364382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:34.365181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.365610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:34.395656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d53ab06-cedb-410b-8475-69978e2bc339 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Jun 15 10:46:34.396219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 987/2072] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:34.497593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:34.498200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:34.506230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.506706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:34.507460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.507886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:34.571115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:34.578713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6950fff-963c-4045-a1b7-3fa65a3a8165 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084787 Jun 15 10:46:34.579147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1086/2073] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:34.978621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:34.979723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:34.986860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.987307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:34.988071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:34.988503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:35.017795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8db10b4b-bbf6-4488-a488-313e33a44326 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Jun 15 10:46:35.018351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 988/2074] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:35.408320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:35.409271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:35.415568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:35.416013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:35.416765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:35.417227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:35.421283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:35.447836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-82a638bd-82d2-408e-b70d-6c5162b96fea tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jun 15 10:46:35.448307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1087/2075] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:35.596060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:35.596668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:35.602646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:35.603084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:35.603830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:35.604257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:35.667783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:35.675700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77f1ba61-2933-465e-861f-c0d413c0099d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083691 Jun 15 10:46:35.676280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 989/2076] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:36.030192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:36.031434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:36.039017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.039464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.040250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.040684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.070542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5c7b512-55f2-48ec-9305-3ab631128403 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Jun 15 10:46:36.071105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1088/2077] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:36.459870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:36.460989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:36.468070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.469038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.470812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.470812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.474351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:36.502038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d57ebaa1-8be0-4a26-b380-d0460f84859d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Jun 15 10:46:36.502613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 990/2078] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:36.692798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:36.693440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:36.699620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.700065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.700814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:36.701276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:36.762928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:36.771079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-01c55e4f-2281-43e1-9c15-f6a641fd29ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082154 Jun 15 10:46:36.771632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1089/2079] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:37.082018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:37.082848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:37.089806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.090246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.090995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.091428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.121996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c8e56775-5eb6-49d9-9292-fbe0cf0192f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Jun 15 10:46:37.122543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 991/2080] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:37.513917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:37.514843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:37.521841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.522284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.523043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.523473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.554422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a94d9603-3717-4d00-8ca0-c4bafa14b76d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jun 15 10:46:37.554967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1090/2081] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:37.788296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:37.788843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:37.795434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.795873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.797427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:37.797963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:37.861163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:37.869103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e371526-2e9e-4726-ba87-e059e9dd4282 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084641 Jun 15 10:46:37.869681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 992/2082] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:38.135094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:38.135921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:38.142690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.143194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.143949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.144373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.174621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9170b3e-dda2-4210-a6b3-306fccd6796a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Jun 15 10:46:38.175201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1091/2083] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:38.566526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:38.567454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:38.573492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.573942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.574713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.575149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.606724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de79879a-228d-48d0-8544-88e64cefd8ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Jun 15 10:46:38.607296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 993/2084] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:38.886741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:38.887310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:38.894074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.894512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.895271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:38.895704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:38.959047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:38.967362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f5cfb90-b2aa-472b-a04b-8818530b75b7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084710 Jun 15 10:46:38.967948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1092/2085] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:39.186445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:39.187808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:39.194551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.194995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:39.195768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.196207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:39.226734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-67007964-dffd-43c6-9212-3dec970081d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Jun 15 10:46:39.233227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 994/2086] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:39.617932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:39.618844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:39.625658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.626105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:39.626862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.627297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:39.656251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6c54176-c039-47b3-a9df-f2362aa1e52d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Jun 15 10:46:39.656808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1093/2087] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:39.985571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:39.986185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:39.992604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.993081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:39.993849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:39.994407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:40.057942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:40.065868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8582de37-ed80-4639-a3f9-b95f27026f06 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085243 Jun 15 10:46:40.066827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 995/2088] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:40.243604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:40.244458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:40.251760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:40.252201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:40.252985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:40.253428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:40.286598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2a2c6db2-8dac-4667-9c14-dfdcabe3a232 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047014 Jun 15 10:46:40.287187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1094/2089] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:40.667119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:40.668073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:40.675516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:40.675952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:40.676718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:40.677187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:40.710435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8a62d65-4eaf-4f42-a5d4-84753724786a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047165 Jun 15 10:46:40.711031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 996/2090] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:41.083801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:41.084404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:41.090872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.091313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.092068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.092497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.154745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:41.163217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9eb0ed86-3eb0-46f3-9d42-7d10d9482639 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083210 Jun 15 10:46:41.163790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1095/2091] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:41.299141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:41.300066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:41.306349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.306800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.307582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.308028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.340556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b572a071-a015-4fd3-a55a-6bffb8b6ff85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Jun 15 10:46:41.341039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 997/2092] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:41.722401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:41.723319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:41.730041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.730484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.731261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:41.731678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:41.762583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a73013df-e181-4d3d-a4bd-7511ff20c288 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Jun 15 10:46:41.763173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1096/2093] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:42.180423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:42.180991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:42.188299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.188759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.189566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.190003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.261793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:42.271724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-23de730b-d180-4355-8106-066302223517 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.095426 Jun 15 10:46:42.272318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 998/2094] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:42.351924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:42.352845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:42.360279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.360725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.361521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.361948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.394179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ab34ff4-10a5-4418-a794-a4d60d4820c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Jun 15 10:46:42.394766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1097/2095] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:42.773721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:42.774688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:42.780942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.781418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.782208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:42.782640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:42.814109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0401bce4-6d0f-42e4-a509-5772c243a5e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Jun 15 10:46:42.814610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 999/2096] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:43.290322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:43.290906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:43.298561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.299001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.299857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.300425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.366701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:43.374912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed792864-00bc-4828-9964-db02499aaa64 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088765 Jun 15 10:46:43.375548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1098/2097] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:43.406944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:43.407907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:43.414590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.415035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.415791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.416228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.446188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-499315d4-2adc-4587-a7d0-8056ffd82073 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Jun 15 10:46:43.446656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1000/2098] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:43.826065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:43.827058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:43.834146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.834589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.835368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:43.835795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:43.865849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84d64c77-6e15-40d4-9982-6669c0144477 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Jun 15 10:46:43.866531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1099/2099] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:44.391363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:44.392362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:44.395456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=88 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:44.401055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.416776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.416776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.416776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.457587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:44.458512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:44.464047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:44.465187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.465619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.466382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.466819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.474630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd303e43-ef9c-4cfc-a6b1-b3c27e331abd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087334 Jun 15 10:46:44.475220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1001/2100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:44.498149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-55cb0036-cc26-485f-9d21-f7f6acc2def5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Jun 15 10:46:44.498701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1100/2101] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:44.877439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:44.878359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:44.884339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.884779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.885604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:44.886033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:44.916885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c06b660-a098-4e38-bd6d-de14d857169a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Jun 15 10:46:44.917461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1002/2102] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:45.491154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:45.491762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:45.498414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.498852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.500287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.501181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.509070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:45.509995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:45.517251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.517699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.518474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.518908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.553532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-498213ff-5aa2-46f7-b4b5-80440e89f433 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Jun 15 10:46:45.554219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1003/2103] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:45.564853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:45.572409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a8a98959-f755-4b7b-81a2-4b131d83db5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085152 Jun 15 10:46:45.572984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1101/2104] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:45.929259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:45.930095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:45.936149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.936686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.938264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:45.938703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:45.968817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-598b5d1d-739d-485e-9117-837e3175f8ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Jun 15 10:46:45.969601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1004/2105] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:46.565319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:46.566241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:46.568656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=84 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:46.573492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.573938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:46.574694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.575134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:46.608604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-304f9b51-08a2-4a62-ac23-598dd4811353 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Jun 15 10:46:46.609882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1102/2106] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:46.661234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:46.661927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:46.668315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.668764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:46.669592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.670030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:46.735253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:46.742924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fab8c0e0-2072-4e80-a4d3-0a53fc8e92a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.157476 Jun 15 10:46:46.743486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1005/2107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:46.980549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:46.981614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:46.987945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.988389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:46.989177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:46.989612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:47.016534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:47.021091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-156ab4ca-4179-47fa-9c25-7e1a32aa156e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Jun 15 10:46:47.021707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1103/2108] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:47.622060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:47.623019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:47.630134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:47.630577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:47.631351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:47.631779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:47.657164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:47.661636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa0dbc45-b939-47d7-a49f-d406f8b73ab2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Jun 15 10:46:47.662233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1006/2109] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:47.759725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:47.760316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:47.768027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:47.768460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:47.769270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:47.769698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:47.834682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:47.842471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-55b723e2-08f7-4054-a745-2586f0fb08ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086627 Jun 15 10:46:47.843070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1104/2110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:48.042548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:48.043559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:48.050545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.050998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.051804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.052242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.081587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-946a3205-a039-419e-84c9-fca2c4bc3a8a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043449 Jun 15 10:46:48.082228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1007/2111] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:48.674054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:48.674975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:48.681283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.681726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.682472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.682897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.712378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a6265d2-e449-4b19-9ca2-630d7dbec358 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jun 15 10:46:48.712915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1105/2112] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:48.861061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:48.861606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:48.868121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.868566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.869354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:48.869789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:48.931248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:48.939889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e63f3ad1-4743-4dde-970d-e0ee2aba2e4a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083399 Jun 15 10:46:48.940526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1008/2113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:49.094467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:49.095412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:49.101835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.102278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:49.103029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.103457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:49.134503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21bb8360-b6a8-448d-b226-9219e0d6ba75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Jun 15 10:46:49.135031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1106/2114] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:49.663415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:46:49.663670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:46:49.724373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:49.725424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:49.731502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.731943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:49.732702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.733176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:49.762920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8bc98c2-f2fb-4ae0-9e15-6f77887b65ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 Jun 15 10:46:49.763483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1009/2115] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:49.957632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:49.958245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:49.964266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.964979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:49.965731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:49.966164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:50.027115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:50.034794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10339f18-bbb8-4592-9474-a804f5d31cd6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081007 Jun 15 10:46:50.035345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1107/2116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:50.147005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:50.148105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:50.154847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:50.155291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:50.156543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:50.157064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:50.187879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97c32154-9c2c-4cad-af3a-06b363a47ca2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jun 15 10:46:50.188440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1010/2117] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:50.774932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:50.775855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:50.782971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:50.783421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:50.784182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:50.784613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:50.813843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b18ad4ed-2ff3-4cad-9d96-32bff2275498 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042645 Jun 15 10:46:50.814172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1108/2118] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:51.051912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:51.052522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:51.058592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.059035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.059793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.060224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.122643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:51.130280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-317a3819-52e2-4deb-909a-53ce8a0aaa89 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082252 Jun 15 10:46:51.130842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1011/2119] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:51.199210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:51.200119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:51.207811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.208255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.209038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.209471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.239380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bcab647f-2e9a-4420-babc-cd363651b96b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Jun 15 10:46:51.239929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1109/2120] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:51.825434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:51.826293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:51.834566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.835002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.835759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:51.836189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:51.868738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c8ebdd7-e5e4-4dca-8ada-31c02ef524e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Jun 15 10:46:51.869450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1012/2121] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:52.147407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:52.147929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:52.154371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.154809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.156079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.156710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.222928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:52.231550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78df487f-81ec-4128-a7f3-7d345eca7cf1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088101 Jun 15 10:46:52.232137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1110/2122] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:52.251586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:52.252514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:52.258853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.259290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.260065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.260493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.293371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e99e70e-9501-4442-bbb2-ca763ac58709 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Jun 15 10:46:52.293952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1013/2123] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:52.881929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:52.882748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:52.889132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.889529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.891287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:52.891774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:52.922025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50167f88-81fa-439f-891c-82990b0767b2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Jun 15 10:46:52.922585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1111/2124] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:53.249129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:53.250468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:53.257019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.257457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.258212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.258643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.305930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:53.306849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:53.315255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.315702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.316516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.316949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.323854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:53.332944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-205f56e2-d7f5-4a80-ab92-ea8ef700858e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087657 Jun 15 10:46:53.335397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1014/2125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:53.352184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-83dc5d68-7f1d-4839-b077-a611c8137024 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050160 Jun 15 10:46:53.352734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1112/2126] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:53.933305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:53.934225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:53.940403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.940848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.941643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:53.942074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:53.971615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dcb55094-8835-421c-8ddc-e85382ebd8a6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Jun 15 10:46:53.972166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1015/2127] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:54.350449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:54.351073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:54.357505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.357940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:54.358801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.359230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:54.363563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:54.364483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:54.371082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.371566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:54.372288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.372719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:54.403915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-37c2c790-7345-4359-940c-bf79905f0b05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Jun 15 10:46:54.404488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1016/2128] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:54.420643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:54.428271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48042ba8-151a-45b6-a34f-36d300a61bee tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081664 Jun 15 10:46:54.428819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1113/2129] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:54.983151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:54.985046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:54.991511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.994026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:54.994026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:54.994026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:55.021888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5db56d8c-6bcf-4a9f-bc91-d3ce90606e0b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Jun 15 10:46:55.034166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1017/2130] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:55.415674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:55.416540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:55.423166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:55.423609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:55.424362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:55.424793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:55.446110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:55.446796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:55.453493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:55.453938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:55.454097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e59164f-e972-48f4-ad5a-df7f057f158f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Jun 15 10:46:55.454672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1114/2131] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:55.454775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:55.455112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:55.517776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:55.525302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9916938-543d-4a7e-96a7-caf91bd2fedc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082924 Jun 15 10:46:55.525871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1018/2132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:46:56.033610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:56.034570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:56.040679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.041161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.041918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.042355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.072294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3605b169-8955-4234-ac14-547194126414 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 Jun 15 10:46:56.072844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1115/2133] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:56.466149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:56.467064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:56.473798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.474241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.474996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.475423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.504734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b15a7c44-d12a-45ae-b386-8d1f5fac4ba0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042750 Jun 15 10:46:56.505363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1019/2134] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:56.544089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:56.544699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:56.552018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.552459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.553246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:56.553677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:56.614704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:56.622243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67202a0f-51d8-4a70-90a9-ced5de783653 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082539 Jun 15 10:46:56.622787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1116/2135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:57.084429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:57.085374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:57.091705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.092145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.094092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.094545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.124185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f93ff39c-5b85-4979-ad98-7780ab1aceb0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Jun 15 10:46:57.124900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1020/2136] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:46:57.517314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:57.518269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:57.524675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.525188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.525945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.526374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.556593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37ea08ff-dc31-44b8-a53c-e5d80f89f6c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Jun 15 10:46:57.557251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1117/2137] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:57.639609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:57.640691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:57.647483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.647921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.648680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:57.649132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:57.710028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:57.717770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d98831d-3329-41c2-b550-bf77cbbe368e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082025 Jun 15 10:46:57.718866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1021/2138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:58.135793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:58.136722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:58.143071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.147045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.147045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.147045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.174769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1fac2913-311f-4d5b-9230-235299cd56ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Jun 15 10:46:58.175317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1118/2139] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:58.568143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:58.569098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:58.575138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.575583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.576341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.576774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.607308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e31550b8-d2aa-4e20-8f22-d453d686980b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Jun 15 10:46:58.607856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1022/2140] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:58.736130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:58.736760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:58.743404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.743845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.744607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:58.745062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:58.806151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:58.814096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-44c51d2e-0e42-46ed-8616-afa85a528feb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082672 Jun 15 10:46:58.814653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1119/2141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:46:59.186414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:59.187729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:59.194203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.194640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.195424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.195852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.371743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:59.384875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c99f674-8d64-4e21-a10c-0ce0ab541e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202473 Jun 15 10:46:59.385455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1023/2142] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:59.619077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:59.619987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:59.626918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.628007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.628285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.628727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.645914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:59.658546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1621c82b-9f86-4493-8a28-eee612e03768 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Jun 15 10:46:59.659200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1120/2143] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:46:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:46:59.831858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:46:59.832450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:46:59.841100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.841547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.842321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:46:59.843051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:46:59.911253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:46:59.919103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c787fc2e-b0ab-4dbc-b7a5-aca601f69698 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091986 Jun 15 10:46:59.919651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1024/2144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:46:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:00.397417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:00.398326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:00.404740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.405329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:00.406394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.407345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:00.438236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e185dc08-9888-47b3-b9d3-d43abf846a37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Jun 15 10:47:00.438781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1121/2145] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:00.670253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:00.672176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:00.678817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.679260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:00.680021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.680512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:00.711007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a59da8f1-9b50-4da4-8386-36d6234158a2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Jun 15 10:47:00.711592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1025/2146] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:00.937340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:00.937783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:00.944152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.944594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:00.945373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:00.945809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:01.008299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:01.016313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b10809a-4bb9-4496-8846-350a85abe085 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083581 Jun 15 10:47:01.016990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1122/2147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:01.449862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:01.450793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:01.457607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:01.457997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:01.458759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:01.459184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:01.489497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44a9b950-b17d-4562-9032-f4bc81358888 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Jun 15 10:47:01.490057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1026/2148] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:01.723396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:01.724244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:01.730928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:01.731360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:01.732137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:01.732570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:01.762917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9f42174-8887-4651-863e-4267df208f54 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Jun 15 10:47:01.763468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1123/2149] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:02.034510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:02.035108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:02.041520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.041959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.042714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.043143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.107517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:02.115843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9370e599-7e9b-4168-82dc-42866f8735b1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086421 Jun 15 10:47:02.116398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1027/2150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:02.501985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:02.502895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:02.508906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.509367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.510110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.510539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.540263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be92cee6-bac1-4245-9e1c-66ab0dc0da88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Jun 15 10:47:02.540809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1124/2151] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:02.775405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:02.776274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:02.783157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.783600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.784357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:02.784784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:02.816238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32a87cff-e49e-4efb-8c18-384d799f9ed4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jun 15 10:47:02.822297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1028/2152] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:03.133441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:03.133974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:03.141180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.141628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.142432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.142880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.203806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:03.211666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc50e899-d1fc-46de-8d30-aafbee4cdb54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082187 Jun 15 10:47:03.212235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1125/2153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:03.552816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:03.560129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:03.560129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.560561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.561998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.562434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.592148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19f867dd-59fb-4c97-94dc-554c5fed5398 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Jun 15 10:47:03.593486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1029/2154] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:03.828624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:03.829536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:03.835748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.836194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.836943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:03.837395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:03.866664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-326834de-a062-4023-9929-b5d0206e07f5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042609 Jun 15 10:47:03.867212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1126/2155] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:04.230151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:04.230766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:04.237250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.237698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.238462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.238901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.301956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:04.309479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d77b67ff-3eb2-4b41-a984-73af7d5e8c5e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083322 Jun 15 10:47:04.310032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1030/2156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:04.603661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:04.604574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:04.611861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.612308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.613095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.613529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.643374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87e1f5df-4b04-45c1-ba5e-3ff7b2542526 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Jun 15 10:47:04.643916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1127/2157] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:04.878950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:04.879795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:04.886505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.886950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.887740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:04.888171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:04.917621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d660cdc-7492-4d6f-82e9-4f80ea4b5ba7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Jun 15 10:47:04.918190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1031/2158] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:05.328277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:05.328887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:05.335183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.335654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.336418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.337013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.403279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:05.412106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28dd75f4-aae6-44bf-b5f1-c928ca0badd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088339 Jun 15 10:47:05.412659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1128/2159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:05.655682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:05.656606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:05.662706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.663158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.664034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.664472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.694072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ebda3b53-e4bc-4cdd-86e6-6be41ae8ce74 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042371 Jun 15 10:47:05.694623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1032/2160] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:05.930221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:05.931060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:05.938897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.939341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.940090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:05.940524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:05.971571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-862158ed-7545-4630-addd-5ec6839e2aec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Jun 15 10:47:05.972117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1129/2161] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:06.429145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:06.429731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:06.436459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.437168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:06.438133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.438562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:06.499520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:06.507271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8c77d57-4c36-408a-a767-13078d2621f7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081980 Jun 15 10:47:06.507827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1033/2162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:06.706444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:06.707385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:06.713620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.714066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:06.715076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.715509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:06.744486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52ff47a5-3d99-49bd-bfbc-1e695d7f89d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 Jun 15 10:47:06.745054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1130/2163] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:06.983924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:06.984788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:06.990829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.991271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:06.992021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:06.992444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:07.022093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f0e468f-ba30-40c3-9ed7-7ab37c7264e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Jun 15 10:47:07.022631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1034/2164] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:07.524171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:07.524918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:07.531931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:07.532381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:07.533175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:07.533617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:07.596830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:07.605846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e9db7646-7026-45de-9550-860ba037e08e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085128 Jun 15 10:47:07.606398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1131/2165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:07.757175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:07.758090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:07.765364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:07.765822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:07.766585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:07.767014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:07.798479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-958e7c2b-e1e4-40c5-b884-f18d24994c64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Jun 15 10:47:07.798961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1035/2166] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:08.034567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:08.035504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:08.041413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.041852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.042596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.043024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.073157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3219d08d-8de6-4bab-bb8a-d0f7bc408cb0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Jun 15 10:47:08.073628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1132/2167] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:08.624877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:08.625519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:08.631726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.632176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.632944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.633396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.699789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:08.708152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53ec3a4b-3d0e-4755-9a99-68f6ed33534c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087769 Jun 15 10:47:08.708703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1036/2168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:08.810048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:08.810848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:08.818190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.818634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.819390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:08.819823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:08.849695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9802744-bf96-417a-8805-6284d2c44344 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 Jun 15 10:47:08.850242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1133/2169] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:09.084924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:09.085897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:09.093117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.093572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.094329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.094761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.124766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-008de00a-db70-4e6f-92da-d7d7ac04e281 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jun 15 10:47:09.125335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1037/2170] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:09.725607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:09.726244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:09.732482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.733050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.733806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.734233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.800317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:09.809672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ee4660c-bcb4-40ad-930a-da6c7a7c19e1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087812 Jun 15 10:47:09.810251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1134/2171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:09.861748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:09.862746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:09.868771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.869244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.869997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:09.870430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:09.901109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50b99143-43f0-4cf6-b5ce-4d70fd5c830d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 Jun 15 10:47:09.901636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1038/2172] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:10.135935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:10.136774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:10.144032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.144477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.145260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.145690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.174896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4637c66-2843-4db5-a0ec-63a4eb0d1441 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Jun 15 10:47:10.175446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1135/2173] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:10.826749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:10.827306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:10.834006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.834448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.835218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.835650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.896847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:10.904274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1a0c3df-f532-4281-a403-7e9e7f0104ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081527 Jun 15 10:47:10.905455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1039/2174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:10.913455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:10.914367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:10.920352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.921794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.922442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:10.922869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:10.951018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-152cb6ff-d0a7-4977-b407-65333a2ad987 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Jun 15 10:47:10.951561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1136/2175] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:11.186768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:11.187621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:11.194151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.195835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.195835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.195835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.199553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:11.227338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eaa9898d-e874-4a69-bec2-f447030062ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jun 15 10:47:11.227916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1040/2176] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:11.921927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:11.922451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:11.929035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.929482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.930238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.930671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.935599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:11.963094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:11.964012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:11.971674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.972118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.972879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:11.973333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:11.992820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:12.001754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05d0abd2-bc0e-4789-9ac3-3b8fe0a48d65 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084336 Jun 15 10:47:12.002284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1137/2177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:12.004708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de8edd33-ab64-4540-9e20-90988987d69b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Jun 15 10:47:12.005292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1041/2178] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:12.121759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:47:12.121960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:47:12.239855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:12.240806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:12.246817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:12.247256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:12.248001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:12.248428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:12.277918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a52079fb-5d7a-4c58-b7be-aca55df1e5d1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jun 15 10:47:12.278495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1138/2179] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:13.015761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:13.016678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:13.019254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:13.019872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:13.023319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.023760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.024519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.024949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.026258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.026700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.027455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.027886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.053591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6a51544-d2f7-4221-8a35-be68e1c88868 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jun 15 10:47:13.054137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1042/2180] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:13.089144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:13.097404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e41ead02-0b71-47aa-8dab-e3e97cddbbcd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081958 Jun 15 10:47:13.097961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1139/2181] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:13.291002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:13.291854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:13.298661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.299112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.299883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:13.300313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:13.330780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41647623-a168-480c-afe4-767d714dc980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Jun 15 10:47:13.331336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1043/2182] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:14.065888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:14.066850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:14.073615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.074356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.075535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.076269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.114188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5a3f128-5622-4d9c-a156-5ee4896b41ad tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052893 Jun 15 10:47:14.114749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1140/2183] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:14.114868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:14.115392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:14.122761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.123208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.123982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.124415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.188485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:14.196072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1042b015-6254-4be4-8b95-6d41efcba2cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085349 Jun 15 10:47:14.196620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1044/2184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:14.344229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:14.345176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:14.351368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.351803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.352544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:14.352996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:14.395185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f78909c-b75c-4e43-9f89-2f3cd1de25f2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056408 Jun 15 10:47:14.395738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1141/2185] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:15.126451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:15.127373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:15.129695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=88 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:15.134453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.134893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.135663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.136079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.165533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8c1da425-bad0-49ea-b5a7-90219b9f13bc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Jun 15 10:47:15.166004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1045/2186] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:15.213589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:15.214130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:15.222496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.222936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.223695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.224160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.286342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:15.294333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cd55fcec-3a9a-4556-9f50-b0add87faa66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084624 Jun 15 10:47:15.294875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1142/2187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:15.409111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:15.410021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:15.416848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.417261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.418029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:15.418456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:15.448893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86505e77-8077-44bd-b9bc-effe13586ac7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Jun 15 10:47:15.449463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1046/2188] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:16.176439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:16.177503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:16.183532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.183972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.184719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.185256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.216126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5042bfe6-fc44-409b-9076-21dd22609cb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jun 15 10:47:16.216812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1143/2189] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:16.312163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:16.312812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:16.322673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.323474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.324840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.325686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.390039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:16.398569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5222b130-8563-4e71-a159-3cfe4fe7b5e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090205 Jun 15 10:47:16.399835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1047/2190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:16.461168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:16.462089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:16.469327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.469775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.470718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:16.471158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:16.502113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aac52664-8bb4-4329-a76e-55711f274331 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Jun 15 10:47:16.502670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1144/2191] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:17.227811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:17.228750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:17.235150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.235594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.236363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.236796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.265609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd00c07e-4b1c-42dd-a35f-4ba3ae53238a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Jun 15 10:47:17.266160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1048/2192] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:17.417301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:17.417947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:17.419981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=86 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:17.424892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.425359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.426124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.426536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.492694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:17.500935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c71215f5-c628-4d9a-9f85-9de9438947a4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087453 Jun 15 10:47:17.501518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1145/2193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:17.513452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:17.515061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:17.521576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.522023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.525000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:17.525000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:17.555045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-28cbab49-a7e8-4d6b-b1f6-3c2ef6a907fc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Jun 15 10:47:17.555612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1049/2194] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:18.277851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:18.278772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:18.285690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.286129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.286885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.287315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.316636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78b086e8-c514-44f3-ab11-4de9c44f94d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Jun 15 10:47:18.317249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1146/2195] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:18.518068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:18.518651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:18.525812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.526254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.527009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.527435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.567064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:18.568619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:18.575292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.575736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.577129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:18.577951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:18.594913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:18.602400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0fed495-d70d-4c3b-8eb8-42b015716e2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088289 Jun 15 10:47:18.603142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1050/2196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:18.607713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ca75a77-f991-4c46-b006-356031233a25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Jun 15 10:47:18.608276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1147/2197] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:19.330497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:19.331430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:19.337963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.338461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.339234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.339919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.372780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e20f6290-422f-4ead-9a62-e576961b23f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Jun 15 10:47:19.373788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1051/2198] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:19.619344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:19.620015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:19.620389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:19.620509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:19.627078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.627290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.627518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.627708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.628283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.628474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:19.628710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.628912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:19.660573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30575fa3-c35c-4a0f-848f-aa204c5c3308 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Jun 15 10:47:19.661175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1148/2199] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:19.692669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:19.700284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75c085d5-4ea9-4338-824b-daa4cf2bb067 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084714 Jun 15 10:47:19.700862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1052/2200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:20.386779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:20.387738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:20.393911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.394349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.395091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.395517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.424779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-796c9399-e7df-480e-839f-d46d7189a858 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 Jun 15 10:47:20.425364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1149/2201] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:20.673002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:20.673859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:20.680313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.680781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.681573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.682006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.710787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-428d2a09-92de-40a9-a9d0-663da188f63b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042489 Jun 15 10:47:20.712242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1053/2202] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:20.718578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:20.719184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:20.725640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.726151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.726836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:20.727268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:20.788489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:20.796706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ea6d19b-b79d-4523-adc0-eabbf7df23ce tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082811 Jun 15 10:47:20.797302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1150/2203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:21.437382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:21.438387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:21.444630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.445112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.445880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.446323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.475837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0d24424-30f9-430f-8ac2-bc4a194722db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Jun 15 10:47:21.476314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1054/2204] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:21.723421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:21.724338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:21.730884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.731272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.732029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.732506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.762849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-763e4bfb-85fb-4cb1-bff5-7069b04ee5b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Jun 15 10:47:21.763423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1151/2205] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:21.813902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:21.814536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:21.821093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.821533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.822299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:21.822734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:21.885561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:21.893848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b0fa33a3-76d9-4abc-99d3-f13ee215b831 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083978 Jun 15 10:47:21.894402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1055/2206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:22.488085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:22.489048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:22.495222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.495660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.496413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.496844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.526454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-686e62b7-8c48-4538-a767-90a343eedd39 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 Jun 15 10:47:22.527018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1152/2207] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:22.775397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:22.776234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:22.783903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.784342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.785406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.785837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.812327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:22.817095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9fe21a3-e0fc-4680-ad98-811c5c68cf0c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Jun 15 10:47:22.817777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1056/2208] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:22.911207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:22.911831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:22.918405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.918842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.919598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:22.920304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:22.987060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:22.990671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:22.995414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ad128d87-f135-423c-84a2-5acff1a2da16 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087940 Jun 15 10:47:22.995987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1153/2209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:23.539530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:23.540486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:23.548756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:23.549225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:23.550030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:23.550461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:23.581632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-106dd861-1f6d-4ec8-a622-daa5f54f31f7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Jun 15 10:47:23.582190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1057/2210] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:23.829031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:23.829869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:23.836000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:23.836445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:23.837223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:23.837663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:23.866688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f6b2ab6-2bc1-4dfe-bcfe-2ed20a20952d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Jun 15 10:47:23.867229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1154/2211] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:24.013557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:24.015194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:24.021237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.021684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.022430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.022863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.083311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:24.091046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddbd1e2e-d673-4537-b0e8-1339fb4233ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081258 Jun 15 10:47:24.091609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1058/2212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:24.594282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:24.595200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:24.601694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.602140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.602913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.603323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.631757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85186268-5b9a-45f0-b0de-ef42cb339561 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Jun 15 10:47:24.632304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1155/2213] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:24.879555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:24.880388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:24.886667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.887109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.887871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:24.888306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:24.917168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9aeb9d5-4e2b-4a6c-910a-afb6504bc287 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Jun 15 10:47:24.917739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1059/2214] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:25.109135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:25.109746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:25.115780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.116221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.116980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.117421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.182750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:25.191311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-37ffb5d8-7602-4085-a4c4-6ee70740ee49 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087369 Jun 15 10:47:25.191867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1156/2215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:25.646897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:25.647572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:25.653776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.654222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.655578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.656010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.687851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ff3ad25-7767-497a-937c-bfe452e4609c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Jun 15 10:47:25.688426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1060/2216] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:25.929761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:25.930616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:25.938693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.939129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.939900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:25.940326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:25.971892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bdf4feab-d233-438b-8b56-69daf3ffc1b6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Jun 15 10:47:25.972444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1157/2217] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:26.208824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:26.209577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:26.216481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.217077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:26.218013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.218448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:26.283598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:26.291527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f1a037f-72bd-47b0-b968-66bea0d7b4fb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086617 Jun 15 10:47:26.292076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1061/2218] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:26.700060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:26.701252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:26.708488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.708922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:26.709725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.710155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:26.744306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36a67888-8e7f-4aa5-8077-a223fd09258b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048360 Jun 15 10:47:26.744891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1158/2219] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:26.985096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:26.986046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:26.992862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.993364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:26.994166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:26.994608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:27.028399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d9a7255-0922-4e8c-940c-f83f038b26fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048010 Jun 15 10:47:27.029013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1062/2220] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:27.309279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:27.309867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:27.317154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:27.317606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:27.318382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:27.318820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:27.387178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:27.395897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fd5733d-95ca-4f76-bada-acfe25f81be1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090532 Jun 15 10:47:27.396480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1159/2221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:27.757370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:27.758286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:27.764761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:27.765239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:27.765996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:27.766431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:27.795687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40db8171-c71c-4756-ad94-25bca3a6e050 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041792 Jun 15 10:47:27.796329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1063/2222] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:28.040172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:28.041069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:28.047985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.048452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.049228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.049665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.078686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4b96cdc-2a04-40c7-b88e-f0945a2d6b29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Jun 15 10:47:28.079234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1160/2223] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:28.413574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:28.414125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:28.420245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.420821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.421689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.422126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.485819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:28.493532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0513055-08e7-4c82-bf93-92340e838830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083942 Jun 15 10:47:28.494102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1064/2224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:28.807826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:28.808775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:28.815891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.816338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.817120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:28.817558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:28.851475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-745561ef-c5ac-4441-813e-d20afaee5b65 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Jun 15 10:47:28.852026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1161/2225] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:29.090954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:29.091936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:29.098867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.099309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.100081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.100510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.131608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8edcf3f-4f55-47e2-b33a-5370369f95ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Jun 15 10:47:29.132159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1065/2226] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:29.511046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:29.511688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:29.518039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.518484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.519281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.519712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.584819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:29.593621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db339418-c575-4fa9-9239-d342b5cd7205 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086532 Jun 15 10:47:29.594191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1162/2227] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:29.863746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:29.864820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:29.871659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.872147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.873318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:29.873674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:29.911688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8a480ab-6b12-44a2-b6c7-c939484f3364 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052125 Jun 15 10:47:29.912268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1066/2228] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:30.144216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:30.145082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:30.151545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.151985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.152769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.153225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.183269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e6ddb32-872d-44e7-98b2-145b208ed747 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Jun 15 10:47:30.183822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1163/2229] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:30.611064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:30.611676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:30.618299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.618746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.619517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.619951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.683059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:30.691561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7234995a-260e-413d-9586-5a80566e29ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084890 Jun 15 10:47:30.692134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1067/2230] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:30.924749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:30.925603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:30.931703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.932142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.932891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:30.933346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:30.963768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d1bca3e-b867-4abc-9e7d-b38fdcbfa1b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jun 15 10:47:30.964334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1164/2231] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:31.195655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:31.196571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:31.203349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.203788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:31.204562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.205018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:31.235215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f05ddfe3-ddf6-4da5-9b6b-1b88e1471933 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jun 15 10:47:31.235775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1068/2232] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:31.707696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:31.708292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:31.715228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.715675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:31.716451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.717480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:31.783181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:31.791014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee9b697a-9a44-4019-bc81-167e89a5362d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087150 Jun 15 10:47:31.791578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1165/2233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:31.976800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:31.977752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:31.985181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.985622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:31.986389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:31.986814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:32.018287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4692ff96-fe7a-4a2f-a792-a1f5d54899ba tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045369 Jun 15 10:47:32.018868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1069/2234] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:31 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:32.246951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:32.247804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:32.254260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:32.254705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:32.255480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:32.255910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:32.289002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ceea4caf-f2ee-4f4e-b9d6-e9bb629eabb1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046087 Jun 15 10:47:32.289581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1166/2235] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:32.810459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:32.811732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:32.818085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:32.823410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:32.823410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:32.823410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:32.886531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:32.894507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6350dd50-02ec-46db-972c-e87fd34b553e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088187 Jun 15 10:47:32.895080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1070/2236] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:33.030267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:33.031212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:33.037926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.038372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.039139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.039571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.070465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56d57927-eeba-4c30-98ea-dff3df7a5df4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Jun 15 10:47:33.070970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1167/2237] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:33.301390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:33.302332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:33.308779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.309311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.310141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.311336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.343836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4482daa2-9d69-4c00-9ab2-743b273927fa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 Jun 15 10:47:33.344319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1071/2238] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:33.911600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:33.912211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:33.918325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.918772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.919521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:33.920825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:33.981355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:33.989770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29c2356b-b6c7-417e-83fc-87c36cdd34ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081998 Jun 15 10:47:33.990338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1168/2239] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:34.082271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:34.083191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:34.089379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:34.090083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:34.090854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:34.091286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:34.122309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78ec66aa-1e7f-4f3f-8756-86e9333ce7fa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Jun 15 10:47:34.122884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1072/2240] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:34.356401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:34.357383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:34.363924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:34.364370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:34.365156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:34.365591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:34.394975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-69055134-1e40-4d35-a907-3b5d73283c65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042660 Jun 15 10:47:34.395558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1169/2241] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:35.007708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:35.008319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:35.015670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.020994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.020994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.020994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.035381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:35.081168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:35.088667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81d6af1c-fd5c-4f4f-b902-d2e5afd8c6e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084900 Jun 15 10:47:35.089248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1073/2242] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:35.134019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:35.134953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:35.142130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.142572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.143322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.143743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.162177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:35.176320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86762165-32ba-4a18-9099-11f7899f037d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Jun 15 10:47:35.176883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1170/2243] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:35.407084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:35.407986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:35.414453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.414894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.415642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:35.416073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:35.445930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c8f08fd-6deb-4ef0-9e34-ddd10c1806e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043793 Jun 15 10:47:35.446492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1074/2244] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:36.105534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:36.106265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:36.114807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.115480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.116354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.116940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.182628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:36.188951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:36.189918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:36.190997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df69b36a-170f-4d1d-b56b-714a4b830acf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089242 Jun 15 10:47:36.191760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1171/2245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:36.196530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.196999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.197774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.198200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.230013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-79947afe-9936-4bf9-b78c-315f6eae8d21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Jun 15 10:47:36.230569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1075/2246] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:36.458774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:36.459789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:36.468378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.468821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.469650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:36.470076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:36.503490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-866a2a30-70a0-41b9-9627-83f6d3a51b1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048608 Jun 15 10:47:36.504049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1172/2247] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:37.208137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:37.208738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:37.215865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.216322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.217668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.218104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.242489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:37.243431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:37.250533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.250984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.251772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.252209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.284886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:37.290882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b03ebbab-5817-4fe0-b16f-158fc6a40d60 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052426 Jun 15 10:47:37.291451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1173/2248] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:37.292567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ffd83ba7-58b4-4f40-b081-716ace4d3475 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088177 Jun 15 10:47:37.293353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1076/2249] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:37.515801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:37.516662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:37.522860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.523289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.524058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:37.524496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:37.555538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cff449fb-0f49-4400-8376-80e30dbf4e26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jun 15 10:47:37.556100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1174/2250] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:38.303127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:38.304074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:38.311285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:38.311956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:38.312938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.313429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.315813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.315813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.320208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.320663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.321486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.321922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.351943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc1fc531-433d-42af-8658-7c3f9bf2344c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052845 Jun 15 10:47:38.352530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1077/2251] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:38.390198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:38.398198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3fbace3-afea-4fa4-97d2-2b8682a1f8f1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091599 Jun 15 10:47:38.398783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1175/2252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:38.568549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:38.569409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:38.575787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.576586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.577392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:38.577825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:38.611468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5741b4e-eee9-4a22-ba9f-457e8572b304 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Jun 15 10:47:38.612052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1078/2253] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:39.365093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:39.366159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:39.373341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.373786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.374790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.375265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.406688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62f21407-06c4-48d1-aac6-0e9a6662fcf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 Jun 15 10:47:39.407245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1176/2254] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:39.415655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:39.416264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:39.423414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.423892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.424670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.425172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.493858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:39.502443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fca320a5-c6a7-45b7-9a6c-10e31540ba20 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090507 Jun 15 10:47:39.503009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1079/2255] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:39.624225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:39.625357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:39.632573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.633047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.633824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:39.634257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:39.668065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1eecafa8-de1b-4476-8ccb-815331196033 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Jun 15 10:47:39.668647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1177/2256] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:40.417910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:40.418828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:40.426121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.426562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.427311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.427739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.458701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-774a6761-320e-4975-be4b-97b1047f5233 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Jun 15 10:47:40.459255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1080/2257] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:40.519998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:40.521024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:40.527599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.528041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.529464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.530367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.596767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:40.604441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b062593-a985-4528-a5ee-065abef25b71 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088288 Jun 15 10:47:40.605019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1178/2258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:40.680845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:40.681706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:40.688625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.689093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.689852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:40.690278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:40.720402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8f74589-b80d-4a0e-9670-90484200b314 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Jun 15 10:47:40.721063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1081/2259] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:41.471572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:41.472495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:41.480193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.480193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.480193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.480593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.511441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c2cc1820-6abe-4013-bc45-0e2d3a21f909 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jun 15 10:47:41.512013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1179/2260] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:41.626390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:41.627029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:41.633943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.634385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.635142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.635571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.697899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:41.706001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-022e3bfb-4e75-45fc-a650-7f8e7dabed90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084081 Jun 15 10:47:41.706602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1082/2261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:41.733568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:41.734527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:41.741943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.742386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.743180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:41.743608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:41.775583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9987a477-c976-42fe-ba24-80c42582d7a6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Jun 15 10:47:41.776144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1180/2262] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:42.524837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:42.525963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:42.532420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.532863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.533664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.534104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.567322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c931fa3-d4e7-405d-893c-15fc0095ec5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047579 Jun 15 10:47:42.567920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1083/2263] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:42.724258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:42.725409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:42.732600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.733793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.734567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.735044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.787985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:42.789046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:42.796753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.797236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.798032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:42.798472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:42.809091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:42.819209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-63d7efa0-c1eb-4731-8c3e-1b6d9491eed8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.099498 Jun 15 10:47:42.819802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1181/2264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:42.839016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1e370d1-71eb-4d88-8a02-2c5ac9a2a93d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055037 Jun 15 10:47:42.839855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1084/2265] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:43.580082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:43.581457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:43.588073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.588513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.589332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.590238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.632148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-25c6257b-481d-49d6-92e7-010e5985e857 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056204 Jun 15 10:47:43.633333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1182/2266] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:43.837997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:43.838699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:43.847108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.847486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.848298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.848727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.855927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:43.858131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:43.869003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.869750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.872728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:43.872728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:43.922035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e2c45c4-7237-41c3-8626-f4d4edd8cfb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073063 Jun 15 10:47:43.922689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1183/2267] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:43.924423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:43.933107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc04233c-dcf7-4984-bb04-8bd62a151cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.099206 Jun 15 10:47:43.933694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1085/2268] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:44.644157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:44.645125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:44.651712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.652153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.652921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.653382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.697555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64d6d29a-a65b-48a8-9e60-aa0ab1e87641 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057390 Jun 15 10:47:44.698136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1184/2269] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:44.934132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:44.935659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:44.943281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.943718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.944494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.944913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.951414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:44.952121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:44.958458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.958901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.959812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:44.960277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:44.981475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ea34ceed-875d-420f-92b6-19a0b87847bc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051049 Jun 15 10:47:44.984078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1086/2270] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:45.029291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:45.037538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93093286-a69e-4bb8-938a-4bc857633113 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089898 Jun 15 10:47:45.038123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1185/2271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:45.710017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:45.711313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:45.714335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:45.722200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:45.722841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:45.724038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:45.724429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:45.765861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9178af92-d6a2-47d3-bbea-187f2c43de18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060435 Jun 15 10:47:45.772616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1087/2272] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:46.005325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:46.006268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:46.012902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.014034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.014858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.015298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.048711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e106908a-8c8d-427e-bbe6-713d6f77fc12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049866 Jun 15 10:47:46.049408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1186/2273] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:47:46.054818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:46.055436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:46.064459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.065124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.066196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.066725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.138917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:46.146841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75d20485-6065-4a6a-a340-6e2e0f37aedd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.095804 Jun 15 10:47:46.147423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1088/2274] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:46.780511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:46.781672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:46.788853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.789355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.790382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:46.790825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:46.795985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:46.827114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-817f3e44-e90d-4c65-9077-c0260cd977ca tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052480 Jun 15 10:47:46.827710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1187/2275] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:47.065454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:47.066403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:47.075282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.076361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.077236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.077678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.111887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-606e738e-a351-46fc-8a43-1e589e0a3146 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053816 Jun 15 10:47:47.112361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1089/2276] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:47.170704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:47.171977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:47.185405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.186526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.187903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.188694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.284831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:47.293324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5f1d5b69-c75e-4af1-a8c7-7d3d435c022e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.131024 Jun 15 10:47:47.294200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1188/2277] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:47.838899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:47.840087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:47.846581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.847024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.847920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:47.848347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:47.852396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:47.883405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6beb27c1-3b93-4d91-80c6-d7d4f7d379d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048546 Jun 15 10:47:47.884077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1090/2278] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:48.124196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:48.125044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:48.126987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=88 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:48.132102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.132546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.133361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.133806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.167099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e8c3dfc-2547-4fd2-8ac5-e6fc0e83902b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047690 Jun 15 10:47:48.167674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1189/2279] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:48.316993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:48.317835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:48.324999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.325792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.326694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.327128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.392183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:48.400550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-45ba6801-d424-4bb9-8a5c-9809e76edfd4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087705 Jun 15 10:47:48.401199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1091/2280] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:48.896284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:48.897236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:48.904050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.904627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.905698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:48.906464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:48.939943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a10da412-3b45-4a16-9eb6-0906e4ef2f0d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Jun 15 10:47:48.940531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1190/2281] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:49.179840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:49.180687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:49.187527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.187966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.188727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.189191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.221779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec7c7e1b-0bdf-46d9-afe0-cc14630026a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Jun 15 10:47:49.222348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1092/2282] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:49.424649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:49.425295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:49.431691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.432048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.432807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.433264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.498199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:49.506049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50a05eb9-f9ce-4eb7-8d29-bbc3f4413fc1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085265 Jun 15 10:47:49.506620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1191/2283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:49.952075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:49.953025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:49.959754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.960206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.960984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:49.961433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:49.992512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb421d5d-5d8d-4158-92c0-7ec6d823252a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Jun 15 10:47:49.993343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1093/2284] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:50.236189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:50.237205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:50.244886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:50.245363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:50.246129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:50.246560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:50.277555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27989d94-2711-4b1e-941b-0ed712d9289f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Jun 15 10:47:50.278104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1192/2285] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:50.526832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:50.526832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:50.531168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:50.531609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:50.532371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:50.532796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:50.595877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:50.603693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6436d74a-462d-4aa5-b9b9-d21739b5b0a1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083998 Jun 15 10:47:50.604251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1094/2286] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:51.004559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:51.005501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:51.011518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.011964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.012718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.013267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.041579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f09f7b5-a599-4d28-bef6-311c0c4047b7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Jun 15 10:47:51.042134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1193/2287] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:51.290556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:51.291435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:51.298080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.298533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.299290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.299723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.332485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f7ed12b-17cf-481a-8624-8c445d68f615 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Jun 15 10:47:51.333082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1095/2288] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:51.621128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:51.621825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:51.629215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.629662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.630431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:51.630855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:51.695827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:51.703716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ecf3b450-911c-4fad-a48e-178b73f740d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086384 Jun 15 10:47:51.704272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1194/2289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:52.054277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:52.055179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:52.061547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.061990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.062755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.063183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.095701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e61a4240-7fd0-40f0-a46e-d3702a0c391b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Jun 15 10:47:52.096419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1096/2290] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:52.345288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:52.346154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:52.352288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.352727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.353515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.353944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.385288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fd0aba5c-8cb2-4aca-b3b6-49c72a14e6b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Jun 15 10:47:52.385852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1195/2291] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:52.721256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:52.721884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:52.728785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.729260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.730032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:52.730535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:52.799716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:52.807800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee16e357-2fc2-4ce7-84a1-5c16e7c2a021 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090606 Jun 15 10:47:52.808414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1097/2292] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:53.108481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:53.109357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:53.116547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.117102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.117930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.118373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.151755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84c6d64a-8ba4-43fb-b8c9-2312db2a6807 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Jun 15 10:47:53.152355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1196/2293] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:53.397877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:53.398707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:53.405248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.411467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.411467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.411467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.438809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec7a1bb2-4bd7-4df3-ac14-5719e8fd7ef6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Jun 15 10:47:53.439415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1098/2294] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:53.833287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:53.833897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:53.840356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.840805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.842511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:53.842768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:53.909748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:53.922302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d7c4073-94b3-4a21-a6b1-b4508872fe45 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090762 Jun 15 10:47:53.922917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1197/2295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:54.163963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:54.164794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:54.172118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.172565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:54.173353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.173784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:54.204267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c2a9623b-edd8-44f5-928b-55968fd4c70c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Jun 15 10:47:54.204834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1099/2296] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:54.451272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:54.452145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:54.458808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.459248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:54.459996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.460423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:54.492357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8947abbf-5e74-47ee-80bb-2b5aac85a5ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045625 Jun 15 10:47:54.492916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1198/2297] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:54.939857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:54.940469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:54.946542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.946985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:54.947741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:54.948184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:55.008569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:55.017109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3dc93dc0-348c-45fa-9121-ad5e47894573 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081213 Jun 15 10:47:55.017676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1100/2298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:55.216166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:55.217193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:55.223277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:55.223774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:55.224519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:55.224947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:55.257723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-079731b1-eee5-45f0-9e7e-d010d4bd256a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Jun 15 10:47:55.258291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1199/2299] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:55.504561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:55.505486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:55.511659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:55.512107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:55.512861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:55.513323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:55.543420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-54201eef-0d52-412d-9b09-43e19e13dc36 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Jun 15 10:47:55.544550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1101/2300] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:56.034891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:56.035563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:56.042816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.043257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.044712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.045180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.107843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:56.115719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ba2d7fa6-b9cc-44b3-a94e-1de1649646d4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084778 Jun 15 10:47:56.116294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1200/2301] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:56.270532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:56.271451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:56.278247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.279388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.280478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.280912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.313286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24b10715-2ba5-4659-9eb1-2048fa307457 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Jun 15 10:47:56.313766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1102/2302] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:56.555937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:56.556855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:56.564183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.564549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.565341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:56.565772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:56.596765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e10bf900-604a-495a-b9ff-3a066162847f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Jun 15 10:47:56.597351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1201/2303] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:57.133127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:57.133727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:57.140502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.140941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.141714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.142141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.202615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:57.210245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b62e74b2-3a1b-44c7-a1b9-ce3e03cb4c2d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081025 Jun 15 10:47:57.210804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1103/2304] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:47:57.324834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:57.326343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:57.332985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.333558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.334320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.334754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.365001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4fd503d-c0bd-4d1d-868a-f6418cec38f5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Jun 15 10:47:57.365558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1202/2305] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:57.608664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:57.609602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:57.616163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.616605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.617393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:57.617826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:57.647270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0aa7f2a-cffc-4e0c-aac6-437c2cc4a06b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Jun 15 10:47:57.647817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1104/2306] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:58.227565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:58.228174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:58.235116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.235563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.236317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.236746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.297957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:58.301410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:58.307555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-46de12ca-2ffd-4d3e-8345-6deed0086d1c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083914 Jun 15 10:47:58.308127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1203/2307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:58.376613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:58.377480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:58.384016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.384461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.385268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.385706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.417311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6a615f3-384b-4c94-b6c6-0a7619fd58a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Jun 15 10:47:58.417868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1105/2308] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:58.660571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:58.661484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:58.668479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.668952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.670160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:58.670594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:58.702790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ad89d6b-398c-4dc3-98b3-294bb245700c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Jun 15 10:47:58.703343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1204/2309] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:59.325594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:59.326131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:59.332109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.332566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.333357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.333790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.399336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:47:59.402926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:47:59.407561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4be90659-a7a2-4ee6-b69e-d37051573576 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086510 Jun 15 10:47:59.408143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1106/2310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:47:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:47:59.429980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:59.430926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:59.437712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.438135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.438891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.439322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.470040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5bfa5918-4acb-473a-9c9d-20fbf0d699c6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Jun 15 10:47:59.470500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1205/2311] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:47:59.714995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:47:59.716460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:47:59.723182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.723566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.724353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:47:59.724788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:47:59.754167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-60679c8a-a023-4973-960e-01a3d7aa7b57 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Jun 15 10:47:59.754740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1107/2312] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:47:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:00.424996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:00.425615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:00.432294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.432731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.433524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.433958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.481639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:00.482653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:00.489582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.490040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.490811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.491243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.498000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:00.506156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b44d4d33-0971-4668-bf1f-325e7219618f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084991 Jun 15 10:48:00.506727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1206/2313] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:00.522572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ebe6128-45d9-41f1-a868-55557000eb45 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Jun 15 10:48:00.523142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1108/2314] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:00.765949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:00.766870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:00.772918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.773392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.774148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:00.774585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:00.803298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-20aa2087-2288-4a75-a839-4235330c6f73 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Jun 15 10:48:00.803833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1207/2315] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:01.524313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:01.524832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:01.533214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.533651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.534425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.534859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.535798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:01.537654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:01.545136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.545590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.546486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.546913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.579719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52ec77d6-9d37-461d-8cb6-c3dfaf70778c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047866 Jun 15 10:48:01.580417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1208/2316] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:01.601611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:01.609343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c350f605-b067-4383-90a7-7477b0994761 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088958 Jun 15 10:48:01.610115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1109/2317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:01.815768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:01.816726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:01.822947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.823387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.824139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:01.824570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:01.857831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99991614-05c5-43af-b759-05aff2118062 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Jun 15 10:48:01.858429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1209/2318] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:02.592438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:02.593383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:02.599967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.600405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.601302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.601734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.633094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce13cde1-c31f-406a-b5bd-44820ba54e29 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Jun 15 10:48:02.633664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1110/2319] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:02.633980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:02.634685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:02.642026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.642498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.643281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.643715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.709735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:02.718252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b4c1147-3aaa-4f4d-b699-7afbbdbda6fa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088226 Jun 15 10:48:02.718822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1210/2320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:02.869689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:02.870530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:02.878270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.878730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.879492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:02.879920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:02.912038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad6cc79a-d009-4e38-bd00-79e77dd12833 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Jun 15 10:48:02.912593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1111/2321] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:03.644109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:03.645071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:03.652039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.652484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.653272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.653709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.685096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7237188c-4412-43a6-adac-bc00a6388f7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Jun 15 10:48:03.685691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1211/2322] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:03.736565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:03.737276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:03.743805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.744252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.745052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.745496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.811238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:03.819220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40ca5dfa-c1f3-4752-b2b8-8532508c1fc3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087750 Jun 15 10:48:03.819839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1112/2323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:03.924774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:03.925766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:03.933320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.933763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.936156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:03.936597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:03.970027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36424322-2bf9-4091-9a34-7748771fc4a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049204 Jun 15 10:48:03.970588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1212/2324] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:04.697363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:04.698287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:04.705122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.705573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:04.706333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.706768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:04.735863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04a039ac-7fec-4939-8ad1-33e72024116b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 Jun 15 10:48:04.736459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1113/2325] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:04.835878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:04.836422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:04.843271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.843716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:04.844478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.844913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:04.905581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:04.913183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1167dd1d-b8a5-42ef-bfdc-0b88d3ee089d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081219 Jun 15 10:48:04.913742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1213/2326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:04.981923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:04.982770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:04.988901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.995105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:04.995105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:04.995105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:05.021227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f41e97b-91e0-457a-94e0-55b817192830 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jun 15 10:48:05.024080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1114/2327] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:05.748400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:05.749367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:05.755424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:05.755862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:05.756605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:05.757066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:05.785818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4780513-6612-42e6-bdf0-7dda61c83ce6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041333 Jun 15 10:48:05.786367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1214/2328] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:05.930270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:05.930830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:05.937357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:05.937800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:05.938556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:05.938988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:06.005025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:06.013163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6409db6a-316c-41df-a301-e7bd51f550af tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086194 Jun 15 10:48:06.013688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1115/2329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:06.034127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:06.035036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:06.041495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:06.041933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:06.042677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:06.043098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:06.071645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d9f1765-f841-4488-a234-9de264706322 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Jun 15 10:48:06.072182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1215/2330] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:06.798244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:06.799115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:06.805278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:06.805720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:06.806473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:06.806903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:06.836771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2905b32f-c0d6-4212-8d36-fc750305c72d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Jun 15 10:48:06.837352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1116/2331] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:07.030821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:07.031449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:07.037508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.038109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.038680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.039114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.083849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:07.084709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:07.092752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.093221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.093977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.094405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.101139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:07.111920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3a0fd2c1-fd21-4c68-bb94-f0a6ba43414e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085636 Jun 15 10:48:07.112498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1216/2332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:07.127898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b249c04f-00b3-42a0-a131-3d2977c7af05 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Jun 15 10:48:07.128451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1117/2333] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:07.848857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:07.849712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:07.855714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.856208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.857600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:07.858027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:07.888111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-418fc5f7-9eef-44fe-b16f-cd16979a4d72 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Jun 15 10:48:07.889258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1217/2334] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:08.129194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:08.129741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:08.137243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.137965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.138605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.139045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.139444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:08.140517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:08.147228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.147678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.148449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.148883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.179167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3771818-1b08-40a7-911c-3534777478c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Jun 15 10:48:08.179739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1218/2335] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:08.202053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:08.209618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9f680de4-64ef-4d6d-9fad-27d9391b211c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084419 Jun 15 10:48:08.210172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1118/2336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:08.900551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:08.901523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:08.908942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.909431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.910205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:08.910637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:08.941729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee0a756f-6863-4799-9daf-e7c853855933 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Jun 15 10:48:08.942317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1219/2337] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:09.192023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:09.192997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:09.199450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.200468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.201382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.201712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.226890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:09.235027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:09.235170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0fa7dfb4-267f-4589-9b65-260b3fbb15e9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Jun 15 10:48:09.235271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.235356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1119/2338] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:09.235436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.235529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.235919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.255410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:09.299258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:09.306759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fef6c3a0-0116-4a22-b49a-9616a427be53 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083814 Jun 15 10:48:09.307510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1220/2339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:09.953934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:09.954853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:09.961002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.961456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.962214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:09.962657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:09.993521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d84526a-0df1-4833-b110-1b884db290de tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Jun 15 10:48:09.994074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1120/2340] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:10.243835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:10.244671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:10.251530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:10.251977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:10.252733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:10.253198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:10.284103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d8169aec-d202-4036-8415-c0d3b4572617 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Jun 15 10:48:10.284650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1221/2341] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:10.325494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:10.326125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:10.332605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:10.333087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:10.333841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:10.334272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:10.397715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:10.409960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10d9b877-ae3f-41ac-a14e-1d1ac8821252 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088759 Jun 15 10:48:10.410528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1121/2342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:11.005257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:11.006166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:11.012255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.013945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.014700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.015129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.045715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a97eff27-4634-425b-9bcb-0984fc44fe30 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Jun 15 10:48:11.046289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1222/2343] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:11.296553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:11.297580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:11.303928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.304377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.305202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.305652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.335846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9d564055-55eb-4680-88dd-55ad7349271b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Jun 15 10:48:11.336477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1122/2344] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:11.427725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:11.428319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:11.435965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.436400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.437184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:11.437612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:11.503328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:11.511272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05521f32-bac3-42db-9d6a-f55962cc759c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087251 Jun 15 10:48:11.511875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1223/2345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:12.058632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:12.059555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:12.065838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.066285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.067045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.067481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.084644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:12.098201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc8cdb90-fb13-476f-8923-2e081049ca50 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Jun 15 10:48:12.098760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1123/2346] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:12 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:12.347912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:12.348747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:12.354897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.355345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.356131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.356700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.385882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a7fb536-8960-4ea4-ad60-fd48007d979c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Jun 15 10:48:12.386431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1224/2347] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:12.528375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:12.529001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:12.538458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.538908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.541557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:12.542000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:12.606014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:12.614510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0ae6d3c-e433-4087-9771-bbbb7c75f1ba tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089953 Jun 15 10:48:12.615069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1124/2348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:13.110693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:13.111642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:13.118278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.118755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.119498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.119935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.150424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-108d40ce-9ca0-4a5b-aaa8-360d1af1c123 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Jun 15 10:48:13.150995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1225/2349] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:13.398420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:13.399245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:13.406033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.406478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.407256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.407744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.439672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f63cbdab-54fb-4a4b-8004-e1226b030cef tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045362 Jun 15 10:48:13.440246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1125/2350] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:13.632291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:13.632894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:13.639602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.640053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.640895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:13.641375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:13.702191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:13.710259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a3152b1-8fab-4b1e-877f-fd3c812ee490 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081850 Jun 15 10:48:13.710819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1226/2351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:14.162837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:14.163761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:14.170335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.170780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.171544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.172003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.201358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-070aca9c-6746-4149-89ca-a0533ad8b2a8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Jun 15 10:48:14.201924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1126/2352] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:14.451129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:14.451965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:14.458316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.458764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.459558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.459994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.490916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0105a8dc-f122-4f69-b58c-ec5fded3a87a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Jun 15 10:48:14.491482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1227/2353] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:14.727967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:14.728580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:14.734614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.735062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.736304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:14.736749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:14.798786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:14.806230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e85d17d1-ca28-486d-8449-1ec03c99d50c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082091 Jun 15 10:48:14.806786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1127/2354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:15.213603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:15.214804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:15.221432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.221876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.222638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.223066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.253263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be711b9e-5210-4b2e-b9c8-33f827372678 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Jun 15 10:48:15.253917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1228/2355] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:15.502657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:15.503481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:15.510081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.510525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.511282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.511714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.542608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dacbd46f-e938-47e1-92a0-a593a2ee6852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Jun 15 10:48:15.542726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1128/2356] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:15.824054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:15.824593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:15.832013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.832460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.833271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:15.833705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:15.898632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:15.907035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d3dd234-7489-4186-941a-d9fc6274e6ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086857 Jun 15 10:48:15.908254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1229/2357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:16.265778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:16.266732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:16.268650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:16.273848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.274443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:16.275250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.275691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:16.306110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-76e6584d-1d4d-4b73-95e8-5edb0152cdb7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Jun 15 10:48:16.306663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1129/2358] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:16.554391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:16.555395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:16.561629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.562072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:16.562821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.563279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:16.594109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e9f48d0-ccc5-41c8-be1e-af1cd1debb40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Jun 15 10:48:16.594679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1230/2359] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:16.926287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:16.926862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:16.934465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.934914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:16.935676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:16.936110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:17.000762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:17.008533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62b62a10-a29c-4c8a-b1e4-f01ec3e1f1e2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086267 Jun 15 10:48:17.009118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1130/2360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:17.318642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:17.319602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:17.326795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:17.327297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:17.328143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:17.328605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:17.365368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f879116d-97bf-4be6-9db2-5b28be4c5999 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051232 Jun 15 10:48:17.366089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1231/2361] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:17.606336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:17.607261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:17.614057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:17.614497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:17.615255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:17.615688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:17.644850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c97fa73-cad4-4894-9f87-195b3675c36b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Jun 15 10:48:17.645439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1131/2362] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:18.025121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:18.025766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:18.031827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.032263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.034010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.034281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.096633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:18.104228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be5010e0-c927-4ee8-a6f6-55bd74078c5f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082928 Jun 15 10:48:18.104985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1232/2363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:18.378543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:18.379443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:18.386072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.386517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.387275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.387712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.418802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5986c370-d981-47cb-b85f-f3fe12937e14 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Jun 15 10:48:18.419364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1132/2364] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:18.656536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:18.657384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:18.663928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.664361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.665129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:18.665559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:18.697393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af5a36be-0185-4923-84d5-fb16b3c8ddd9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Jun 15 10:48:18.697946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1233/2365] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:19.121823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:19.122504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:19.128725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.129216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.129977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.130417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.190922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:19.198559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82c60126-f2c3-4229-84d0-eb4b41f204dd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.080649 Jun 15 10:48:19.199123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1133/2366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:19.430175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:19.431160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:19.433403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=90 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:19.438232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.438675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.439461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.439969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.470260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-442628e6-62fb-41b3-923b-52abc5b80732 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Jun 15 10:48:19.470801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1234/2367] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:19.710040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:19.711078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:19.717782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.718220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.718964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:19.719392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:19.749069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-804096ff-84da-47bb-ac70-4d109cdac7b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Jun 15 10:48:19.749612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1134/2368] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:20.216274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:20.216883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:20.224228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.224672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.225451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.225882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.290169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:20.297923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ca1b26ad-f6d3-4f91-9a16-c19c7231ce90 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085753 Jun 15 10:48:20.298491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1235/2369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:20.483418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:20.484289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:20.491274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.491712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.492492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.492922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.522819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b295da59-bbee-4736-96a6-aaeae79b0a64 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Jun 15 10:48:20.523381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1135/2370] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:20.761908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:20.762732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:20.769269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.769706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.770451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:20.770917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:20.800806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5cd2922d-6e14-4a74-a80b-5bd8fdda44ec tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042940 Jun 15 10:48:20.801379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1236/2371] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:21.316432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:21.317070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:21.324279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.324721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.325518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.325951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.387069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:21.395411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-415078a9-c6f3-4a58-aa4f-66928540f1d0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083597 Jun 15 10:48:21.395969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1136/2372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:21.534654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:21.535496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:21.542101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.542831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.543298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.543726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.547534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:21.573238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fee0ee68-7df7-4aae-ad60-86717fe16491 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Jun 15 10:48:21.573789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1237/2373] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:21.812057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:21.813020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:21.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.820126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.820884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:21.821346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:21.851360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-701228df-9cc9-4893-bd25-37a78c74bd11 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Jun 15 10:48:21.851906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1137/2374] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:22.411730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:22.412330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:22.419095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.419533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.420278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.420704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.480887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:22.489187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9976cccd-3ab5-480f-b60e-ac7ecb8b13d3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081373 Jun 15 10:48:22.489745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1238/2375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:22.586171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:22.587099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:22.594477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.594920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.595680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.596699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.626831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3590a81-d398-4cab-8a84-0fe95aabaa85 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046100 Jun 15 10:48:22.627436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1138/2376] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:22.863900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:22.864905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:22.871609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.872047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.872811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:22.873298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:22.904053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d0046ca4-8e6a-483e-b824-558e48937993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Jun 15 10:48:22.904608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1239/2377] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:23.508671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:23.509204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:23.515259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.515829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.516624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.517080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.581145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:23.588876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25b0a64f-272c-4563-8b50-f10f28774c78 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084406 Jun 15 10:48:23.590297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1139/2378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:23.638592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:23.639537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:23.646565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.647011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.647796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.648229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.677587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8ea1eeaa-91e7-4b09-a997-b6836c6a5488 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Jun 15 10:48:23.678141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1240/2379] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:23.915313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:23.916141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:23.922650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.923088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.923864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:23.924846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:23.928484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:23.954365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd0524b2-1334-4b0a-b55f-eb73d2022b82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Jun 15 10:48:23.954952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1140/2380] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:24.606531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:24.607146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:24.614020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.614470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:24.615231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.615670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:24.676746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:24.684395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-796f7171-4c44-48cf-b9c6-b99cafaead46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081767 Jun 15 10:48:24.684977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1241/2381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:24.688778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:24.689858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:24.696543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.697090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:24.697842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.698271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:24.729987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-729cada0-a9de-4a0d-a34b-537aed87ef57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Jun 15 10:48:24.730560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1141/2382] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:24.966575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:24.967493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:24.973522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.973962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:24.974706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:24.975131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:25.005655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-72820dd3-2938-421b-8403-6153b2ae60c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Jun 15 10:48:25.006217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1242/2383] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:25.701573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:25.702139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:25.708742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:25.709215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:25.710045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:25.710475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:25.742389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:25.743470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:25.750032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:25.750481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:25.751248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:25.751678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:25.775318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:25.782002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e4f568a-db8a-4f07-8c9e-55d61fd13ba5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Jun 15 10:48:25.782886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1243/2384] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:25.783251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2cd65f2a-2f12-4c36-ba7c-78e1efce9d46 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085724 Jun 15 10:48:25.784421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1142/2385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:26.017221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:26.018814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:26.025044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.025485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.026228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.026656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.056008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d11a00d1-66b4-4bc2-a5bb-fbca8ba257cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Jun 15 10:48:26.056551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1244/2386] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:26.795379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:26.798907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:26.801357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:26.801974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:26.803271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.803720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.804482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.804908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.808444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.808898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.809684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:26.810117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:26.835982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4957425-4d94-4aae-b941-95ff9cd0df21 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Jun 15 10:48:26.836542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1143/2387] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:26.874456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:26.883120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b85b472-914e-4156-a7f4-16e13656bb35 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086055 Jun 15 10:48:26.883751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1245/2388] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:27.067917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:27.068745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:27.074878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.075324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.076079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.076510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.106328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8c052cb-c72d-45e6-91c0-0b071f410adc tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Jun 15 10:48:27.106883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1144/2389] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:27.849013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:27.849865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:27.856291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.856730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.857686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.858151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.888158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c64d6530-6701-4b07-a60f-5ea726853114 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Jun 15 10:48:27.888712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1246/2390] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:27.901855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:27.902465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:27.909618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.910045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.910800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:27.911261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:27.973755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:27.981197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bbce855d-5621-4e72-998c-1d9dcf5288c9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083257 Jun 15 10:48:27.981753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1145/2391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:28.119061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:28.119902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:28.126119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:28.126561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:28.127836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:28.128267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:28.158824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c27ef628-9e92-4c04-b15f-601a3a993152 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043831 Jun 15 10:48:28.159522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1247/2392] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:28.900064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:28.901089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:28.907640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:28.908239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:28.909535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:28.909964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:28.938774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9e00503-60b4-4725-ad4a-54ba15cea0f6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042727 Jun 15 10:48:28.939310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1146/2393] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:28.999094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:28.999697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:29.006361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.006801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.007553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.007973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.070841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:29.078298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e063a0fa-a7e0-4172-9b70-b1c5a830401e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083070 Jun 15 10:48:29.078847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1248/2394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:29.170841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:29.171700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:29.177804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.178239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.178983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.179408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.209471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5894485-5dda-4c46-b1b1-7c2a354039f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jun 15 10:48:29.210033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1147/2395] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:29.950346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:29.951264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:29.957750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.958190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.958944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:29.959375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:29.990732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-168ff7f3-e4c5-4751-8601-5a1e37b1e75d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Jun 15 10:48:29.991300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1249/2396] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:30.096736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:30.097421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:30.103776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:30.104215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:30.104986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:30.105416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:30.168403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:30.176562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-418ceec6-1ddc-48d3-8484-bb048b60f27d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084349 Jun 15 10:48:30.177152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1148/2397] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:30.221434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:30.222582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:30.229079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:30.229521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:30.230273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:30.230696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:30.260781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99975e83-76a0-4201-8a5e-11535ed90530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043850 Jun 15 10:48:30.261359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1250/2398] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:31.002573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:31.003488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:31.009557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.010001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.010753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.011227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.040092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-88d93733-71eb-489d-9826-4df15af3815b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041483 Jun 15 10:48:31.040664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1149/2399] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:31.194005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:31.194637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:31.200741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.201222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.201978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.202412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.265510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:31.272327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:31.273297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:31.273995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee3ba0d9-d16a-402f-8179-ea237776d203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083865 Jun 15 10:48:31.274561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1251/2400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:31.280140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.280588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.281498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:31.281937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:31.311573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e4197e5-09a3-41fa-80d4-f3e27145e85c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Jun 15 10:48:31.312125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1150/2401] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:32.052484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:32.053469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:32.059531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.059975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.060742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.061200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.090433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df69a3b1-f8a1-4c8c-ab35-34ec629f6b9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Jun 15 10:48:32.090985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1252/2402] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:32.290364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:32.290966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:32.297741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.298183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.299549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.299998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.322921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:32.323816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:32.330356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.330836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.331683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:32.332116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:32.358060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:32.362286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:32.363823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d228c780-14c2-4f3f-ad99-144308cbb2a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Jun 15 10:48:32.364397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1253/2403] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:32.370522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2eaa6dca-c6ca-4171-85ed-5d881f8e122a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083937 Jun 15 10:48:32.378749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1151/2404] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:33.101628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:33.102538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:33.109214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.109660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.110415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.110851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.140088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-802eab9e-c881-4219-8a51-1241ba156c33 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Jun 15 10:48:33.140647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1254/2405] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:33.375622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:33.376518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:33.383728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.384212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.384923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.385376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.394253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:33.394858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:33.401567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.402015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.402813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:33.403248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:33.418982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d0bca0c6-d418-4c5a-af0c-cefaaaa57499 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Jun 15 10:48:33.422069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1152/2406] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:33.468676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:33.476618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8189f13a-5b20-4838-8d37-f71e2223727d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086874 Jun 15 10:48:33.477469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1255/2407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:34.153549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:34.154543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:34.161522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.161969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.162739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.163169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.192886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86f22ae0-82d9-4ffc-9b78-d8442babb04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Jun 15 10:48:34.193475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1153/2408] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:34.430850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:34.431679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:34.438569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.439007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.439796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.440285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.469370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3fa95f44-9fb2-49e4-9bf6-8aafb48a4d66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042529 Jun 15 10:48:34.469917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1256/2409] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:34.494454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:34.495049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:34.501489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.501932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.502832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:34.503265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:34.567379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:34.574996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-842e2ce2-e208-46c9-874e-dbd40d811e33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084471 Jun 15 10:48:34.575555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1154/2410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:35.203891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:35.204804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:35.210950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.211383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.212130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.212568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.242785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-00bac229-30e0-44f8-a8b1-062c63c6588c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042792 Jun 15 10:48:35.243331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1257/2411] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:35.481836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:35.482673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:35.489544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.489983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.490749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.491176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.520760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56afc7c8-6b2a-4e90-b67f-6aeac75452f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043029 Jun 15 10:48:35.521493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1155/2412] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:35.592861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:35.593521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:35.601209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.601656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.602424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:35.602857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:35.668012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:35.676677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21596f20-18b1-4e33-b913-28b1e3dd06db tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087916 Jun 15 10:48:35.677359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1258/2413] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:36.255066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:36.256156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:36.262387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.262832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.263588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.264017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.289877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:36.294310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ffbac9f-89ea-4dff-ba4f-fe016bed1537 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Jun 15 10:48:36.294870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1156/2414] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:36.531819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:36.532653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:36.539392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.539841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.540631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.541108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.571486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e7d9a579-54e6-4a2e-9df9-bc65aae64e9e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Jun 15 10:48:36.572050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1259/2415] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:36.694582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:36.695319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:36.701838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.702286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.703068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:36.703473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:36.766061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:36.774462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d4c0a68-7fd9-47dd-bda7-15f7666624ed tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084624 Jun 15 10:48:36.775050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1157/2416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:37.306718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:37.307656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:37.315101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.315571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.316322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.317360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.345676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c63e228f-8105-4dbd-83ac-ac346c3a6cdb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Jun 15 10:48:37.346214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1260/2417] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:37.584127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:37.585142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:37.591570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.592013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.592787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.593242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.624411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d31e587a-b3ac-4afa-820d-75005a379f75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jun 15 10:48:37.625008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1158/2418] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:37.792502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:37.793060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:37.799305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.799799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.800554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:37.801500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:37.867771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:37.882932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7abd521-30b7-4dd3-a915-6daf55a70bab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.094520 Jun 15 10:48:37.883509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1261/2419] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:38.357014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:38.357942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:38.365153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.365601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.366357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.366791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.396324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fd49d4d8-b969-4063-92d2-6ea200453c22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Jun 15 10:48:38.396876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1159/2420] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:38.636998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:38.637820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:38.644283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.644751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.646075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.646505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.677063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b52154e-358e-4dc2-9139-c6a0f311d8b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Jun 15 10:48:38.677750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1262/2421] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:38.900001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:38.900534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:38.906637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.907086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.907852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:38.908322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:38.971173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:38.980004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-836c69d5-5608-49eb-9ee7-787fec08ab38 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083883 Jun 15 10:48:38.980577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1160/2422] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:39.113892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:48:39.114429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:48:39.413733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:39.414763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:39.420884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:39.421374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:39.422150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:39.422585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:39.452747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62c1362f-3e49-47fb-95db-47066febc068 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 Jun 15 10:48:39.453332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1263/2423] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:39.688360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:39.689308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:39.696885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:39.697362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:39.698131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:39.698569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:39.729310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b827c68-a1b8-4a82-acc0-cc11a83b6edf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Jun 15 10:48:39.729871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1161/2424] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:39.997403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:39.997993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:40.005601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.006037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.006796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.007221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.069179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:40.076794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3c58858-d8cb-435c-afc9-520fa1730e47 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083160 Jun 15 10:48:40.077400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1264/2425] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:40.464030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:40.465247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:40.471497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.471945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.473307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.473781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.507937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fb8755b2-9988-4512-910d-bbbd6ea16d62 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047905 Jun 15 10:48:40.508519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1162/2426] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:40.741843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:40.742694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:40.749193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.749637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.750407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:40.750847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:40.783153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c30f50ae-bf0f-4b21-8589-a42fce5acf14 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045908 Jun 15 10:48:40.783735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1265/2427] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:41.094391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:41.094974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:41.101750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.102213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.102976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.103407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.167475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:41.178834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c76ccdfb-284a-4e6f-b58e-995b21056d11 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088197 Jun 15 10:48:41.179429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1163/2428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:41.520425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:41.521419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:41.528610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.529078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.529874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.530316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.578739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ed7b217a-ac7a-4465-b0b3-0a4596384575 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062455 Jun 15 10:48:41.579837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1266/2429] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:41.795179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:41.796015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:41.803743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.804195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.804992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:41.805431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:41.837039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b613326-688d-4935-976f-79db2a798760 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Jun 15 10:48:41.837610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1164/2430] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:42.195993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:42.196524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:42.202967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.203431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.204186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.204606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.273889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:42.281524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6d73cd6e-9e37-4b97-a797-a9b034d4c961 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089484 Jun 15 10:48:42.282091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1267/2431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:42.591631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:42.592538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:42.600136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.600578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.601363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.601792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.632086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c55ef3b0-58d5-45ae-8c71-eb1eb6a5877b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Jun 15 10:48:42.632629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1165/2432] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:42.849591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:42.850387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:42.857328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.857770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.858588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:42.859022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:42.891449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-96b77fb4-9a9e-4cba-b7ff-6d0b7c5233a9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Jun 15 10:48:42.892015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1268/2433] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:43.299724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:43.300832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:43.309025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.309479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.310252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.310683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.377585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:43.385629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2afeb5f0-3e03-4a20-a86d-2dd334fc5341 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089881 Jun 15 10:48:43.386201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1166/2434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:43.646753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:43.648195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:43.656060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.656516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.657337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.657773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.692079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e88bb9ba-d37d-43a6-82ad-b4595973ba5e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051541 Jun 15 10:48:43.692683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1269/2435] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:43.903478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:43.905005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:43.912105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.912541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.913341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:43.913775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:43.944658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47e5efce-36e2-4d1d-b24c-5e4dca13235c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Jun 15 10:48:43.945242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1167/2436] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:44.402899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:44.403504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:44.410171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.410619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.411391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.411821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.432188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:44.477972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:44.486350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-287d3e0b-8efd-4fbc-bab8-a4f95018362a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087437 Jun 15 10:48:44.486942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1270/2437] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:44.703936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:44.704870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:44.711245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.711685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.712441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.712867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.746638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce4984af-d8fe-4abd-ac03-47a579bd0480 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Jun 15 10:48:44.747220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1168/2438] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:44.956736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:44.957584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:44.964046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.964500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.965552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:44.965982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:44.998076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-87407050-bf7f-4cee-80c5-e75900ff2b44 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045816 Jun 15 10:48:44.998646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1271/2439] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:45.504345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:45.504981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:45.511619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:45.512007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:45.512773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:45.513233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:45.642327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:45.650314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d241f989-99b9-4b12-a1f3-e29774ae3cff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.149801 Jun 15 10:48:45.650893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1169/2440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:45.759318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:45.760612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:45.768309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:45.768679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:45.770017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:45.770462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:45.803401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0d05daa0-f7bf-4cd2-a751-d3bbedffa5a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048738 Jun 15 10:48:45.803978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1272/2441] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:46.010524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:46.011443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:46.017774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.018217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.019025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.019892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.049774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98a7161c-baa1-4938-8c88-2c8fe1318cc4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Jun 15 10:48:46.050322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1170/2442] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:46.668897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:46.669461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:46.676228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.676676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.677498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.678035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.812628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:46.816026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:46.818486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:46.821772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-753a406c-69d2-40a2-a07d-89c597ddec5c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.156970 Jun 15 10:48:46.822449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1273/2443] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:46.825413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.825856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.826625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:46.827051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:46.869992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-903db9a4-c5d3-40ad-8063-7183ac8cff58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058480 Jun 15 10:48:46.870587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1171/2444] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:47.061831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:47.062744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:47.070059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.070497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.071247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.071673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.102615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ff0745c3-4782-4864-a32a-253fdc4b28fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Jun 15 10:48:47.103191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1274/2445] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:47.838816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:47.839405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:47.842021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=86 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:47.847907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.855547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.855547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.855547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.881946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:47.882834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:47.889736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.890214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.890971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:47.891399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:47.919609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:47.926570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3d3797b-bd19-47b8-8eaf-d9139393baea tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048315 Jun 15 10:48:47.927155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1275/2446] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:47.928938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d1ee79e-a67f-44e2-9468-ba4633e520c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.094093 Jun 15 10:48:47.929523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1172/2447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:48.114293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:48.115118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:48.121382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.129508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.129508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.129508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.154757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f702ad55-0cfa-4580-a0ae-022fca9afc6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Jun 15 10:48:48.155337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1276/2448] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:48.938976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:48.939860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:48.946359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:48.947560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:48.948065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.948065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.948764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.949436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.953343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.953793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.954570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:48.955066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:48.966536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:48.980313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e84ae1c-2e45-43a1-80a0-d89bcddc0b28 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Jun 15 10:48:48.981174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1173/2449] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:49.021455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:49.032196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ba87e37-3af6-4af3-a9fc-7d0ea25f1c54 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089557 Jun 15 10:48:49.032767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1277/2450] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:49.167937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:49.168846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:49.175022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:49.175469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:49.177221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:49.177653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:49.207283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10345756-668f-4c6e-b789-8aaae053e11c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Jun 15 10:48:49.207793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1174/2451] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:49.992000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:49.992914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:50.000049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.000490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.001330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.001759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.034477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ca84253-128a-4cc8-bdbc-6b2f741df265 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Jun 15 10:48:50.035165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1278/2452] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:50.050144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:50.050972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:50.058018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.058467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.059238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.059673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.130179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:50.138350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0bd4f675-eb42-4b2f-ac11-c24c9254d710 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.092029 Jun 15 10:48:50.138942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1175/2453] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:50.219722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:50.220642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:50.222650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=90 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:50.227755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.228197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.229263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:50.229698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:50.265899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64417ac4-3b3a-4a1c-96ec-ad09bf02d0ac tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049945 Jun 15 10:48:50.266384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1279/2454] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:51.046411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:51.047330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:51.053762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.054440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.054970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.056559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.089303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c726157-17dc-4d2c-b879-3f447f2855db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046718 Jun 15 10:48:51.090126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1176/2455] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:51.143626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:48:51.144239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:48:51.155996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:51.156633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:51.164944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.165403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.166163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.166590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.229444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:51.237270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d2c475b2-1f7f-4e05-ab23-707d1ed4a308 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084959 Jun 15 10:48:51.237839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1280/2456] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:51.279892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:51.280844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:51.287822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.288261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.289055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:51.289491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:51.318967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b4e7275-d579-426d-8780-8e4a0b2775c1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Jun 15 10:48:51.319443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1177/2457] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:52.102086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:52.103012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:52.109220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.109699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.110463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.110900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.140239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f0c3abc-68c8-4344-a190-1dcf4ad50dd6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042888 Jun 15 10:48:52.140780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1281/2458] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:52.255140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:52.255904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:52.262597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.263040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.263806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.264242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.330161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:52.331349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:52.332450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:52.338867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85f404d4-5923-4041-b461-e6d0e846e5cc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088212 Jun 15 10:48:52.339449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1178/2459] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:52.340292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.340869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.341733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:52.342206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:52.373686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-011ca9d5-e671-4dfb-9714-1b734b74b457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046796 Jun 15 10:48:52.374180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1282/2460] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:53.152571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:53.153520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:53.159752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.160201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.160989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.161466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.190716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82ce0c48-a612-4def-9ca1-988810196458 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042013 Jun 15 10:48:53.191282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1179/2461] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:53.356044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:53.356645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:53.363308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.363747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.365415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.366009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.386102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:53.387243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:53.393706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.394154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.394977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:53.395416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:53.432399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a7d884bb-971e-4353-8791-e3321a65fa7f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050219 Jun 15 10:48:53.432707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:53.433170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1180/2462] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:53.440836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5deb6f4c-415f-4add-8b24-84c9c1d83ff6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088510 Jun 15 10:48:53.441438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1283/2463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:54.203110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:54.204058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:54.210823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.211262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.212023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.212480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.243287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd57cfbc-567d-46a9-9cb5-f966aca091ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Jun 15 10:48:54.243915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1181/2464] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:54.447380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:54.448312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:54.455339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.455711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.456487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.456935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.460107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:54.460726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:54.467958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.468399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.469196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:54.469627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:54.491884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-010ce0ff-08b5-46df-8a78-f82a8b56e3d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049078 Jun 15 10:48:54.492792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1284/2465] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:54.535947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:54.541157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9bc5b0dd-84df-4167-bb83-f3d154cddf88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086106 Jun 15 10:48:54.541734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1182/2466] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:48:55.257637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:55.258522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:55.264832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.265299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.266069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.266501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.299019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7c0b95a1-7fd0-4cc9-9f1e-3e0454af9b48 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046930 Jun 15 10:48:55.299572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1285/2467] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:55.505322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:55.506258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:55.512604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.513012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.513786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.514220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.548456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85da2152-63f3-4265-ad88-477d2312ca5e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047728 Jun 15 10:48:55.549055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1183/2468] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:55.558321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:55.558936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:55.565680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.566125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.566891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:55.567506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:55.638091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:55.646138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-94d53b56-4543-48e8-8555-47fd27fceb59 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091486 Jun 15 10:48:55.646602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1286/2469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:56.312068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:56.313007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:56.319812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.320390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.321306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.321742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.354049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-766f7e3e-c5f9-418d-b91a-bd391dca9d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Jun 15 10:48:56.354609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1184/2470] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:56.559918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:56.560774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:56.567479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.567862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.568631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.569100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.573628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:56.600898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c77b622c-5cce-4c77-b3c7-968fe5a41d61 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Jun 15 10:48:56.601515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1287/2471] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:56.663381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:56.664089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:56.672270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.672740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.673545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:56.673980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:56.743750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:56.751812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e6904194-920c-4abb-bc93-855185d5462d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.092285 Jun 15 10:48:56.752390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1185/2472] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:57.365709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:57.366657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:57.373330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.373779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.374535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.374968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.405422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2234ef2e-1a39-4b71-87a8-921079018277 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Jun 15 10:48:57.405977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1288/2473] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:57.613297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:57.614290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:57.621424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.621875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.622675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.623105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.656490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1888a482-722f-4a89-a8b3-a38940826b40 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047497 Jun 15 10:48:57.657113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1186/2474] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:48:57.771175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:57.771789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:57.779000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.779449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.780257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:57.780689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:57.849819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:57.859383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-61efcb5c-93cc-469a-ae68-5819021e787f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.092004 Jun 15 10:48:57.859968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1289/2475] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:58.417922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:58.418857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:58.425501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.425957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.426812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.427379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.459407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f401a45-49f2-4296-8d3d-9b497e9905d0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Jun 15 10:48:58.459989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1187/2476] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:58.670417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:58.672014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:58.682464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.683258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.684617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.685448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.742875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-49656f70-a269-48c5-b263-4e3478b79d28 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078084 Jun 15 10:48:58.743663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1290/2477] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:58.881194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:58.881825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:58.888723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.889192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.889962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:58.890394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:58.957214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:48:58.966237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-894a5b90-88fc-495e-a2d6-b87952883d8f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088947 Jun 15 10:48:58.966819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1188/2478] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:48:59.472387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:59.473379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:59.480705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.481179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:59.481971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.482407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:59.518738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9163f0bb-c1bf-43b9-be2d-3691a08bf40c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050386 Jun 15 10:48:59.519231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1291/2479] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:59.757846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:59.758970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:59.764981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.765457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:59.766226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.766662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:59.798479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4ec61c3-33ea-4c83-bf19-5fd8fff8dc16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Jun 15 10:48:59.798964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1189/2480] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:48:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:48:59.984459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:48:59.985094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:48:59.991396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.991833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:48:59.992672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:48:59.993140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:00.057924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:00.067667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ba1764c-bb1f-4ef3-9ea2-f178ff0b2830 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087088 Jun 15 10:49:00.068253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1292/2481] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:48:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:00.533262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:00.534206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:00.541949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:00.542393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:00.543161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:00.543589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:00.547921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:00.575956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e41c8913-9e00-407b-be2b-ec4a0b2cfe88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Jun 15 10:49:00.576532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1190/2482] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:00.810308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:00.811164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:00.818603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:00.819388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:00.820718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:00.821461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:00.871153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-259fd77f-d29e-459e-ba6d-79267063a06a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064626 Jun 15 10:49:00.872026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1293/2483] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:01.085185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:01.086395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:01.093846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.094287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.095048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.095481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.160548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:01.168246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfc1e9e4-71ab-482a-a8ee-133d23b1e446 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087193 Jun 15 10:49:01.168799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1191/2484] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:01.588228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:01.589177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:01.595912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.596348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.597158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.597589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.631064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f95b7fa1-35ef-46d2-8939-b58889d041dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Jun 15 10:49:01.631641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1294/2485] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:01.883264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:01.884098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:01.890948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.891390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.892197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:01.892630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:01.924687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d82c2500-c855-494b-b7e9-cc176573e572 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Jun 15 10:49:01.925288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1192/2486] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:02.186168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:02.186752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:02.193581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.194029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.194799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.195335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.259490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:02.267212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9bf76bfc-eca7-4b31-b6cc-e50e0c036f8b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084988 Jun 15 10:49:02.267775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1295/2487] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:02.644420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:02.645427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:02.653364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.653810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.654584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.655012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.691684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1bad4227-216d-446c-a09e-53b776b96ad1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051454 Jun 15 10:49:02.692502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1193/2488] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:02.937316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:02.938162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:02.944805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.945841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.946651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:02.947088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:02.980597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-54825528-107b-4833-9076-91afb4b377ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047362 Jun 15 10:49:02.981203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1296/2489] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:03.285201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:03.285819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:03.293378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:03.293867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:03.294760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:03.295302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:03.363361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:03.372542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77dcbb03-4b67-4668-bac1-e87e32126f0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091299 Jun 15 10:49:03.373164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1194/2490] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:03.704934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:03.705899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:03.713997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:03.714443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:03.715500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:03.715933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:03.750859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa6d47a2-87fc-4398-9aca-1f23074982e5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 Jun 15 10:49:03.751460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1297/2491] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:03.997345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:03.999023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:04.010330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.011111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.012530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.013369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.047761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-daf09c31-387c-4080-8830-504eeaafe586 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057743 Jun 15 10:49:04.048342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1195/2492] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:04.396054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:04.396576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:04.404817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.405296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.406060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.406488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.474822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:04.483370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-76fb1b0a-08b2-469c-ac75-373b98a7522c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091225 Jun 15 10:49:04.483954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1298/2493] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:04.763445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:04.764373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:04.770824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.771276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.772064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:04.772504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:04.805886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-905abd76-481e-4bf1-a19c-63feec38e1aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Jun 15 10:49:04.806490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1196/2494] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:05.059234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:05.060085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:05.066994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.070545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.070545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.070545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.102019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-737f4832-5cc5-4fdd-aa72-03a758f7adf5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Jun 15 10:49:05.102597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1299/2495] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:05.501796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:05.502406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:05.509801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.510248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.511058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.511489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.583656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:05.593158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-838ea8f3-0676-4733-876a-304898394f4e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.095158 Jun 15 10:49:05.593748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1197/2496] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:05.818274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:05.819127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:05.826756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.827208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.828098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:05.828544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:05.863456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8fa0c6ff-6915-40cb-8e7f-a0e4d3a3487c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Jun 15 10:49:05.864106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1300/2497] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:06.113965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:06.114805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:06.121930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.122367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.123172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.123606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.155253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-276c1437-bee7-4cfb-9f8f-afd57dd9a828 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Jun 15 10:49:06.155833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1198/2498] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:06.615921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:06.616527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:06.624584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.625063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.625842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.626272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.694650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:06.709750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a344025-e065-48e4-9602-5b7baf29ba7a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.097630 Jun 15 10:49:06.710334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1301/2499] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:06.875699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:06.876592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:06.883907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.884349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.885173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:06.885608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:06.919321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98f74449-c20b-4c09-b11c-348fb49a56e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Jun 15 10:49:06.920147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1199/2500] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:07.167577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:07.168427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:07.175565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.176016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.176807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.177284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.209110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-685c4475-2f10-43c4-b175-1f004ff360e3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Jun 15 10:49:07.209703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1302/2501] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:07.730496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:07.731197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:07.737975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.738423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.739211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.739649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.807942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:07.816386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1f5bdf0d-294d-402c-ab5b-9f9856d34f3d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091886 Jun 15 10:49:07.816999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1200/2502] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:07.932181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:07.933165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:07.940050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.940501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.941303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:07.941741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:07.969129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:07.973884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2fa5782b-5432-4977-9844-6e7f75e4abd8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046414 Jun 15 10:49:07.974456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1303/2503] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:08.221895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:08.222818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:08.230842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:08.231208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:08.231983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:08.232419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:08.274226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98f4f5de-3d7f-48b6-9c7a-5713ca3be256 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056318 Jun 15 10:49:08.274817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1201/2504] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:08.834478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:08.835092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:08.844499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:08.844955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:08.845772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:08.846214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:08.925210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:08.934451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d3d2776-fd03-48b6-b5d0-0af321be1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.103746 Jun 15 10:49:08.935147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1304/2505] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:08.998350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:08.999470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:09.006557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.007096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:09.009069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.009340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:09.042618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df10bdda-66ff-404b-a44f-d9d540fae04d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048359 Jun 15 10:49:09.043200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1202/2506] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:09.290828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:09.292442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:09.300169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.300796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:09.302227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.303011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:09.339250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a41246ca-ebc0-4a1b-851c-d5b6ea68a9c4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056270 Jun 15 10:49:09.340092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1305/2507] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:09.952666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:09.953294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:09.960234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.961269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:09.962558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:09.962993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:10.029687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:10.037749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-74758d5b-2e3a-4609-83dd-6bd942863481 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089148 Jun 15 10:49:10.038334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1203/2508] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:10.054821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:10.055778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:10.062066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:10.062509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:10.063279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:10.063708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:10.096874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f249e48c-82a6-4355-973f-c5f65096cb84 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Jun 15 10:49:10.097488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1306/2509] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:10.352492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:10.353390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:10.359712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:10.360163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:10.360936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:10.361397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:10.392886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12028b36-e321-4502-849b-1dee9059a0cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Jun 15 10:49:10.393498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1204/2510] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:11.056391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:11.057029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:11.063680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.064129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.064894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.065352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.107813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:11.108744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:11.115341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.115787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.116548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.117061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.126806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:11.135493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8132e2d-3595-4541-a504-c0b434359e55 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082946 Jun 15 10:49:11.135988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1307/2511] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:11.147821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c98e6983-b557-46c8-bb34-86af74a7078e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Jun 15 10:49:11.149041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1205/2512] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:11.404863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:11.405743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:11.411988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.412443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.413255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:11.413842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:11.446354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88f0a81e-c209-47fa-b8b9-8f6b31b33b68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Jun 15 10:49:11.446956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1308/2513] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:12.154863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:12.155506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:12.160154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:12.161131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:12.162400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.162842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.164832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.165302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.168921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.169405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.170190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.170628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.201176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4d72f4d-4879-4825-9c7e-a5d469289bab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Jun 15 10:49:12.201762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1309/2514] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:12 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:12.236401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:12.239836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:12.244467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d945f239-8933-44c4-88f1-046bfa7ca7bb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.094766 Jun 15 10:49:12.245064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1206/2515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:12.458306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:12.459383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:12.467722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.468174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.469086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:12.469632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:12.501597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f19c9ffe-5d41-45f6-8fdc-736c921e8293 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047267 Jun 15 10:49:12.502175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1310/2516] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:13.211871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:13.212789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:13.220373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.220818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.221623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.222058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.253603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-62b483e7-b494-44a7-80b1-0f821887cb66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Jun 15 10:49:13.254189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1207/2517] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:13.262311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:13.267391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:13.270118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.271085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.271431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.271732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.343824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:13.352227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-230a5204-fab7-4f56-a262-b0e90bb17220 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.094006 Jun 15 10:49:13.352842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1311/2518] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:13.513321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:13.514289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:13.520773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.521267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.522041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:13.522477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:13.555824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fb1d2759-d2a4-4f8b-832b-ccf12a992b59 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Jun 15 10:49:13.560817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1208/2519] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:14.266397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:14.267427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:14.274196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.274640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.275413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.275846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.307888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a9023fd-2d92-4e1e-88e4-7823bc115768 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Jun 15 10:49:14.308459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1312/2520] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:14.371081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:14.371688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:14.379388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.379941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.380924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.381492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.452607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:14.463771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4fcb9adc-42d2-4682-8d68-db551849d95b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.097657 Jun 15 10:49:14.464339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1209/2521] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:14.567874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:14.568846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:14.576145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.576586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.577381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:14.577816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:14.622387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-95204923-605f-447b-ba05-5a5af66e7388 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058445 Jun 15 10:49:14.622968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1313/2522] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:15.322183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:15.323103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:15.329828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.330275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.331042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.331939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.378235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d88a407-9870-42e9-883a-5036dfbd614e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061254 Jun 15 10:49:15.381895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1210/2523] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:15.480812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:15.481537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:15.488408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.488853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.489708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.490141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.561865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:15.569707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-01f9727b-6bf1-43d8-ade1-c9aa0356e71c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.092874 Jun 15 10:49:15.570799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1314/2524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:15.638372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:15.639751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:15.647433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.647880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.649231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:15.649784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:15.682270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84a4140a-0efb-4146-86f0-b2079ffea5d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051500 Jun 15 10:49:15.682835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1211/2525] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:16.390474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:16.395285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:16.397906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.398965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.399735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.400364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.432122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e7382b5-6534-41ec-9710-067190b1c621 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045602 Jun 15 10:49:16.432690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1315/2526] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:16.588941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:16.589566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:16.596387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.596768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.597550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.597983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.666278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:16.673687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb4bde67-f658-490e-a74e-a7663d296fd7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089841 Jun 15 10:49:16.674275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1212/2527] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:16.694348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:16.695261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:16.702004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.702451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.703232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:16.703666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:16.735402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-236c9425-8153-47c2-86b6-451fcddd4e83 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Jun 15 10:49:16.736016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1316/2528] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:17.444175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:17.446241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:17.452430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.452875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.453678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.454110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.484751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6969755c-639e-43f9-aa0a-4afaea6ce26e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jun 15 10:49:17.487793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1213/2529] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:17.691161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:17.691768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:17.699118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.699764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.700250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.700695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.749110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:17.750043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:17.756619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.757263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.757973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:17.758511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:17.765370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:17.773122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-640a2497-48d1-4705-bd2c-7607abf2d9ef tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085898 Jun 15 10:49:17.773709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1317/2530] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:17.790770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32b0c7c4-6139-463d-8a77-1834f736fdcf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Jun 15 10:49:17.791348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1214/2531] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:18.498179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:18.499121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:18.505246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.505694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.506459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.506890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.537629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5023b8a9-1d45-4dc4-9c0c-0555a8be9d92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Jun 15 10:49:18.538194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1318/2532] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:18.791399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:18.791973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:18.794304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=86 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:18.799223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.799687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.800546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.801012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.802601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:18.803544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:18.810568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.812312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.812312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:18.812525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:18.847581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-14d8af24-3ab3-4b86-9442-88d62cfe06ad tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048774 Jun 15 10:49:18.848197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1319/2533] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:18.870446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:18.878570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2ff29e61-830b-4f2a-b60f-4ec5fe7adb72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091837 Jun 15 10:49:18.879167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1215/2534] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:19.550142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:19.551075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:19.557975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.558540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.559163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.559589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.577128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:19.591853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4524b8ae-d953-4563-bfc8-ae02a10079eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Jun 15 10:49:19.592409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1320/2535] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:19.859837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:19.860694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:19.869660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.870218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.871006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.872888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.896008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:19.897367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:19.903950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-87117144-6ca4-4f92-8bc1-4efb44322c1f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048098 Jun 15 10:49:19.904534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1216/2536] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:19.905547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.906002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.906757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:19.907180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:19.974881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:19.982713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9edaa9b-9173-444f-8715-8f12a751ab57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090894 Jun 15 10:49:19.983291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1321/2537] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:20.604099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:20.605046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:20.611620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:20.612068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:20.612841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:20.613349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:20.645070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3405536e-f46d-40e6-b4ef-e8a4a7d3a105 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Jun 15 10:49:20.645625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1217/2538] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:20.916312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:20.918250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:20.920733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=86 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:20.925944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:20.926387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:20.927147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:20.927575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:20.959517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e6ef760-10f1-4323-bf28-cf17bbe0840b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047293 Jun 15 10:49:20.960085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1322/2539] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:21.000079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:21.000714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:21.007606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.008658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:21.009449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.009886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:21.073395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:21.081259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c6669e6f-4ca2-47bd-bdea-13696898fe5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085052 Jun 15 10:49:21.081828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1218/2540] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:21.657756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:21.658696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:21.666030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.666473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:21.667235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.667671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:21.697589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92f1ad81-e6aa-4f22-8a83-9e896e4aef79 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Jun 15 10:49:21.698159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1323/2541] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:21.972000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:21.972981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:21.980439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.980874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:21.981668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:21.982124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:22.011376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-87bc5e89-9b96-43ef-90d7-a787e22fbb76 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Jun 15 10:49:22.012042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1219/2542] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:22.099603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:22.100260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:22.107196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:22.107644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:22.108430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:22.108862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:22.363572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:22.371797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f2dc578c-03fb-4ae6-a6d3-381311488e75 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.276115 Jun 15 10:49:22.372359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1324/2543] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:22.708849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:22.709803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:22.716266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:22.716708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:22.717519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:22.717951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:22.748321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4bb099f8-991f-4dab-8b63-bc1f8e4abd54 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Jun 15 10:49:22.748900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1220/2544] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:23.023557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:23.024497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:23.030732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.031181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.031937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.032370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.062928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b6d31fc7-60f4-4089-b3ac-d88aeaeadb63 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Jun 15 10:49:23.065533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1325/2545] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:23.388550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:23.389191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:23.395767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.396213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.396992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.397434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.463205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:23.470195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5954881f-8d5f-44bf-a34c-49fd013d3809 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085352 Jun 15 10:49:23.470781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1221/2546] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:23.760083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:23.761053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:23.767568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.768012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.768776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:23.769234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:23.799634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a7a91bc5-9c15-45b8-8765-7ceb5e6829d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Jun 15 10:49:23.800108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1326/2547] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:24.075081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:24.075914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:24.082105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.082544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.083588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.083712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.114180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-87248e6f-c9fb-4f2d-9a0b-e4c8dcc09335 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Jun 15 10:49:24.114734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1222/2548] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:24.488008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:24.488613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:24.495267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.496143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.496906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.497377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.558561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:24.566498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf8bcce0-6b7b-4ee9-b7c8-423b3551bbb0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082439 Jun 15 10:49:24.567078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1327/2549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:24.811734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:24.812565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:24.819187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.819611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.821001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:24.821439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:24.838959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:24.852403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1015b1b6-df77-434a-a22c-f203f37b4d15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Jun 15 10:49:24.852927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1223/2550] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:25.126005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:25.126836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:25.134386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.134852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.135612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.136061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.167192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85b20e7f-69b6-4290-acd1-614884a6ccae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045248 Jun 15 10:49:25.167750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1328/2551] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:25.583837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:25.584450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:25.591215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.591658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.592572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.593031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.658858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:25.666872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a0630186-eba2-4fc3-925c-69a366927456 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087137 Jun 15 10:49:25.667470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1224/2552] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:25.863936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:25.864796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:25.872175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.872604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.873408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:25.873862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:25.903795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5000ac8-2250-4fb7-bffd-7e1ffa6308e9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Jun 15 10:49:25.904351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1329/2553] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:26.178990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:26.179979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:26.186724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.187164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.187921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.188348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.220402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-125b6856-ee69-44db-84cb-6397033a2871 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Jun 15 10:49:26.220968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1225/2554] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:26.684866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:26.685517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:26.692318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.692761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.693564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.693996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.757596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:26.765561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1fd3cbff-b971-4598-854a-d29ab62801e5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084662 Jun 15 10:49:26.766129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1330/2555] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:26.916518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:26.917410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:26.923661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.924099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.924854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:26.925315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:26.954936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1167f2e7-4477-454f-bda7-0df50e80f069 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043331 Jun 15 10:49:26.955492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1226/2556] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:27.232943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:27.233905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:27.240008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.240444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:27.241239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.242215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:27.273409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ad5432e-dbab-4179-9d09-b28c4da1ac92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Jun 15 10:49:27.273973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1331/2557] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:27.784221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:27.784921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:27.792787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.793182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:27.793951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.794384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:27.858565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:27.866126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7e9db04-a61c-4421-87ff-e438575deb41 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085938 Jun 15 10:49:27.866716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1227/2558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:27.967675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:27.968616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:27.975135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.975574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:27.976926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:27.977475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:28.006605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5a6ec38-53db-462a-a810-d26a341c8012 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Jun 15 10:49:28.007170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1332/2559] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:28.285094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:28.286021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:28.292228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:28.292709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:28.293510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:28.293949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:28.324133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4255098-382b-4390-aaac-80792cc073df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Jun 15 10:49:28.324690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1228/2560] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:28.882939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:28.883485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:28.889771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:28.890209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:28.890960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:28.891389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:28.953196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:28.961210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-24cd3b09-e920-4dd1-b259-832d6c6c0f0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081736 Jun 15 10:49:28.961905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1333/2561] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:29.018159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:29.019097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:29.027060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.027498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:29.028259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.028684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:29.059144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-236db33d-33c7-4c9c-9c96-c39f50ea992c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jun 15 10:49:29.059699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1229/2562] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:29.336373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:29.337731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:29.345192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.345647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:29.346488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.346867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:29.378091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e2f53820-255d-4107-896e-3551eddd883e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Jun 15 10:49:29.378664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1334/2563] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:29.979791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:29.980402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:29.986502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.986943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:29.987702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:29.988140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:30.050114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:30.057845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9466ffe-e9f0-471b-8326-195ab07dd884 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082713 Jun 15 10:49:30.058428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1230/2564] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:30.070562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:30.071470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:30.077939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:30.078380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:30.079483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:30.079916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:30.110500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-72ee01eb-3f9b-49cd-a370-950f84a5c32f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Jun 15 10:49:30.111050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1335/2565] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:30.390296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:30.391163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:30.397541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:30.397982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:30.398738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:30.399713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:30.435366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-21974ed5-dc11-4068-af62-4fa2755256a4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049259 Jun 15 10:49:30.435915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1231/2566] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:30.790812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:49:30.791115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:49:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:49:31.077017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:31.077694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:31.084916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.085413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.086213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.087225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.123176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:31.125020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:31.131836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.132367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.133448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.134496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.153675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:31.161387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5f6cffa0-ac48-491e-9ff3-9e0198a4415e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089978 Jun 15 10:49:31.161958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1336/2567] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:31.166040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b6c8b2d-6384-44d9-9b65-b8a80fdf6fd0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Jun 15 10:49:31.166624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1232/2568] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:31 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:31.447788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:31.448666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:31.454829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.455266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.456023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:31.456444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:31.460218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:31.487406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-13776234-edfe-4584-9017-77e33178edeb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Jun 15 10:49:31.487953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1337/2569] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:32.177971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:32.178600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:32.178982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:32.179245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:32.185542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.185986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.186257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.186700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.186812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.187166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.187452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.187881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.219532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53277b92-cad3-4765-9248-4e966d524bf1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Jun 15 10:49:32.220118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1233/2570] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:32.250886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:32.259385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-725c20a3-c9cd-4b81-9b47-62f5e12a832e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083677 Jun 15 10:49:32.260126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1338/2571] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:32.499496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:32.500404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:32.506562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.507001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.507748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:32.508180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:32.540447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d72b69d-a2d0-423e-8f0a-0d8f9008abcb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Jun 15 10:49:32.541215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1234/2572] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:33.231169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:33.232217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:33.238875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.239311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.240091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.240519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.270967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b88a3ed-1272-4842-9dc7-d8e05fde626b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jun 15 10:49:33.276375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1339/2573] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:33.277905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:33.278524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:33.285240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.285684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.286536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.286967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.351396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:33.359154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-47231b01-3a3c-404b-b742-cdd3a10451aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085958 Jun 15 10:49:33.359740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1235/2574] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:33.553344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:33.554258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:33.561235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.561677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.562482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:33.562912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:33.595124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-de2a5100-6037-4b08-b26d-8f5667787732 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Jun 15 10:49:33.595705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1340/2575] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:34.283095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:34.284034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:34.291547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.291987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.292741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.293206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.322424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6eb7d86f-880b-4e27-bd9f-84c5407e9e5d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Jun 15 10:49:34.323119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1236/2576] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:34.377086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:34.377691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:34.384240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.384762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.385541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.385974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.449695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:34.457532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-857864d6-28a8-4cc9-a849-f6540d4185cb tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084373 Jun 15 10:49:34.458084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1341/2577] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:34.607071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:34.607995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:34.614173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.614616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.615376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:34.615811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:34.645379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ecefaec-7272-4f53-9f17-3f2e96989fe5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Jun 15 10:49:34.645949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1237/2578] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:35.334541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:35.335490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:35.342435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.342872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.343626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.344053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.374541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-191fa1c7-e836-4eb9-ad70-5beb84b5389f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Jun 15 10:49:35.375085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1342/2579] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:35.475582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:35.476177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:35.483222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.483663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.484433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.484867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.550237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:35.558478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ede192fb-cce7-4539-a94a-0e80e66f78a8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086756 Jun 15 10:49:35.559034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1238/2580] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:35.657239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:35.658160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:35.667817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.668262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.671687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:35.672134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:35.704785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-97bf1c2a-99c1-494d-aafb-b82367c7b460 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051468 Jun 15 10:49:35.705361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1343/2581] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:36.386300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:36.387240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:36.393462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.393911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.394708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.395145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.424403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b5a7c31-1768-4133-bb3b-c24d5bb0210a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Jun 15 10:49:36.424990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1239/2582] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:36.576632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:36.577105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:36.583542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.584002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.584789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.585347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.647471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:36.655407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8faf6b76-5e3a-4bb9-9d13-69737ba4fa37 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082854 Jun 15 10:49:36.655981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1344/2583] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:36.717759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:36.718710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:36.725281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.725735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.726516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:36.726951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:36.732182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:36.759554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77b5446c-9483-40f9-9691-cb0dc9aac638 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Jun 15 10:49:36.760132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1240/2584] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:37.436356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:37.437289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:37.444054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.444503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.445278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.445745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.479060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa3e9c11-72e4-4ddd-8911-986ae181a11e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046832 Jun 15 10:49:37.479624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1345/2585] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:37.672390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:37.673014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:37.679101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.679549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.680303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.680745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.741949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:37.749925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-80b36b4e-f2ae-4fda-a939-29cfc52f66d8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081719 Jun 15 10:49:37.750486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1241/2586] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:37.772563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:37.773515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:37.781045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.781497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.782267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:37.782721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:37.812854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-20f7046e-1dce-4025-b04d-4b811f07e398 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Jun 15 10:49:37.813433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1346/2587] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:38.490838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:38.491753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:38.498825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.499777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.500628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.501101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.532602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56c923ca-3835-4bcd-9f39-96a64a32e515 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Jun 15 10:49:38.533195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1242/2588] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:38.767400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:38.767966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:38.775284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.775735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.776507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.776948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.824474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:38.825426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:38.832174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.832616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.833445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:38.833878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:38.845060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:38.853708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-575741ff-45aa-4544-922f-2c15d66dc794 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089475 Jun 15 10:49:38.854807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1347/2589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:38.865769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc8daba7-f5c1-4473-be06-0c403512e5f0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Jun 15 10:49:38.865994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1243/2590] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:39.544426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:39.545389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:39.551690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.552138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.552908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.553374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.584569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9a4f6d8-789d-4dfa-b94e-a2629aa9f812 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Jun 15 10:49:39.585144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1348/2591] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:39.873092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:39.874027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:39.880426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:39.881922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:39.884778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.885588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.886836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.887536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.892519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.893282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.894447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:39.894985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:39.936522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-12dc2864-a16c-488b-a767-facc37299dde tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062617 Jun 15 10:49:39.937123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1349/2592] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:39.962870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:39.971115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c15312a6-1a31-4584-9ca8-378cb7955c4b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.104179 Jun 15 10:49:39.971695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1244/2593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:40.597868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:40.598790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:40.605773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.606224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:40.606986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.607421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:40.640465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c644f62c-2e0e-4e7c-9f97-a1ca876bc26b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047146 Jun 15 10:49:40.641061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1350/2594] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:40.948204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:40.949108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:40.955839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.956285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:40.957093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.957529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:40.989094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:40.989737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1ec185a2-6859-4f49-8e68-4ea5f69ee50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Jun 15 10:49:40.989867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:40.990069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1245/2595] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:40.996428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.996909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:40.997718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:40.998156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:41.060616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:41.068268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e8376729-4d58-42a4-9a45-27632360fb0d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083023 Jun 15 10:49:41.068902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1351/2596] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:41.652670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:41.653615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:41.659697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:41.660142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:41.660905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:41.661363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:41.690771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-556209b8-7e32-4a04-b8e5-5b17fbd65fa8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Jun 15 10:49:41.691320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1246/2597] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:42.001229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:42.002190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:42.008633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.009596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.010350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.010806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.039367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-72a45f39-bb8f-4769-b088-45a4d8c5089a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042056 Jun 15 10:49:42.039912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1352/2598] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:42.085726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:42.086338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:42.093778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.094218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.094968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.095399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.156102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:42.166913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5aefe980-2854-41b6-8eb9-188d1414966d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084938 Jun 15 10:49:42.167492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1247/2599] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:42.702747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:42.703700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:42.710048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.710500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.711306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:42.711747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:42.738430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:42.742952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e50f2a8e-e7e5-491c-96d8-70008f58fc9e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Jun 15 10:49:42.744284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1353/2600] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:43.051246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:43.052169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:43.059050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.059497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.060244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.060668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.091752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c76dacfc-79d3-4568-9f5b-c4c8c83aca3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Jun 15 10:49:43.092470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1248/2601] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:43.184711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:43.185340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:43.192173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.192605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.193389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.193825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.257012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:43.270535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e79a5a7c-136f-4860-9471-2317d5ead098 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090089 Jun 15 10:49:43.275010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1354/2602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:43.764115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:43.764987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:43.771042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.771481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.772233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:43.772660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:43.805571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f63ab388-d705-4c14-a48a-eb25774f4803 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Jun 15 10:49:43.807410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1249/2603] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:44.104152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:44.105038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:44.111248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.111699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.112458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.112892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.145376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f6d3b68-5b3b-48f8-97b5-d5268755deb8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Jun 15 10:49:44.145942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1355/2604] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:44.297183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:44.297782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:44.304347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.304976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.306418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.307038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.372206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:44.379869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33e9c209-a1ce-41b7-bef1-cd028ac1592f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086507 Jun 15 10:49:44.380425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1250/2605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:44.819000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:44.819916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:44.826455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.826895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.827657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:44.828089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:44.860242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-05eb5c65-c302-4314-b527-cf90386a9dff tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Jun 15 10:49:44.860813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1356/2606] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:45.157272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:45.158097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:45.164123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.164776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.165578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.166137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.197402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-604b9beb-d3f7-4d25-9f52-f9350c8f994b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Jun 15 10:49:45.198011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1251/2607] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:45.397474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:45.398087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:45.404834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.405355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.406242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.406679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.469449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:45.477382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f43baacb-6571-45a8-a860-1c117a4c2c08 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083848 Jun 15 10:49:45.478881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1357/2608] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:45.873936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:45.874815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:45.881130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.881579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.882374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:45.882812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:45.913150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec43d470-7636-4779-bd66-f50263494833 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Jun 15 10:49:45.913730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1252/2609] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:45 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:46.209366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:46.210342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:46.218365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.218807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.219585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.220015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.254228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e64187c-3329-4a5a-8220-8115c8cd94f9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Jun 15 10:49:46.254795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1358/2610] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:46.497832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:46.498358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:46.504841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.505333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.506117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.506554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.581206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:46.589858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-af492bad-3a27-4ee7-9dc9-41b84e916714 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.097705 Jun 15 10:49:46.590464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1253/2611] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:46.925795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:46.926721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:46.935265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.935774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.936616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:46.937133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:46.972126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10605930-4e98-477c-b3c1-bd2157595680 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050405 Jun 15 10:49:46.972701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1359/2612] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:47.265828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:47.268586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:47.273891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.274505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:47.275319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.275884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:47.317417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a92a2f4-8ecb-4a5f-9398-70b245d4d993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055475 Jun 15 10:49:47.318021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1254/2613] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:47.609021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:47.609646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:47.616110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.616553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:47.617363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.617801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:47.686002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:47.694195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e975a758-58ce-4d68-81a1-557db678d7bd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.090104 Jun 15 10:49:47.694829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1360/2614] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:47 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:47.984759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:47.985743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:47.992556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.993768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:47.994677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:47.995115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:48.031386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7dd219d-bda1-4b60-b029-a7d8186600bd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050722 Jun 15 10:49:48.032007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1255/2615] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:48.329405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:48.330262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:48.337784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:48.338259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:48.339064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:48.339854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:48.374172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79d4f71b-b38d-46ed-aa91-69d376c7d7cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048738 Jun 15 10:49:48.374782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1361/2616] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:48.713615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:48.715129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:48.721918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:48.722360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:48.723175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:48.723607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:48.787173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:48.791868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:48.796212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4dfc881f-5e20-40c6-8a3a-855a999c0b51 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087863 Jun 15 10:49:48.796779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1256/2617] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:49.043855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:49.044675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:49.050864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.051306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.052062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.052489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.083406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c6b8ec3-3450-46cc-a4f0-da9e1ff0e29e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Jun 15 10:49:49.083994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1362/2618] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:49.387221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:49.388080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:49.390068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:49.395344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.395806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.396603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.397068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.430265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec33bf5f-5110-4c86-92b6-193b5b046301 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048099 Jun 15 10:49:49.430853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1257/2619] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:49.820890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:49.822222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:49.829045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.829486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.830246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:49.830674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:49.893364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:49.901014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c7056ef-2026-4d8a-b565-9a95af767bc2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083874 Jun 15 10:49:49.901698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1363/2620] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:50.097679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:50.098513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:50.106516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.106963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.107839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.108277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.139844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7cc13937-6e84-458c-9035-36bd0303a704 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046242 Jun 15 10:49:50.140416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1258/2621] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:50.442204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:50.443240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:50.449892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.450334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.451100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.451734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.482917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cab5186b-6c01-46d5-a0bd-02e2078194de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 Jun 15 10:49:50.483482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1364/2622] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:50.918437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:50.919050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:50.925283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.925727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.926525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:50.926964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:50.990006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:50.999046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac9cb586-83b9-4a24-9b8c-696a938eefb8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084578 Jun 15 10:49:50.999627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1259/2623] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:51.153301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:51.154249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:51.161215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:51.161664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:51.162438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:51.162989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:51.195287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6925d823-9fcf-4993-ba98-2dec324bbc03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046924 Jun 15 10:49:51.195784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1365/2624] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:51.496037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:51.496987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:51.503489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:51.503935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:51.504699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:51.505159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:51.536136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92937f5d-1da2-4e81-8b22-51f96b0de141 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Jun 15 10:49:51.536695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1260/2625] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:52.016197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:52.016814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:52.018696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=88 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:52.023587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.024163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.025445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.026099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.089259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:52.097856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bceaef76-d728-4e0f-bf20-38ca96151192 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085461 Jun 15 10:49:52.098443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1366/2626] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:52.207814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:52.208726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:52.215645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.216095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.216858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.217323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.247862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1abbaaf-a05f-4321-a285-1703c368fa8f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Jun 15 10:49:52.248430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1261/2627] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:52.547770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:52.548716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:52.555152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.556372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.557168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:52.557599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:52.586929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0dd20f9d-7210-4e02-8e6f-128f42794464 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Jun 15 10:49:52.587488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1367/2628] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:53.114300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:53.114919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:53.121503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.121946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.122701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.123265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.190370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:53.199256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86f4c29f-11f0-4b32-a4b0-ac28be316c01 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088814 Jun 15 10:49:53.199838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1262/2629] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:53.261316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:53.262242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:53.268645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.269129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.269887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.270312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.303817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a97b0785-a122-4d7f-8762-9749d8c48924 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047978 Jun 15 10:49:53.304401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1368/2630] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:53.598599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:53.599516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:53.607702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.608178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.608946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:53.609407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:53.639391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c814c0e6-2e45-4d06-80a2-b9e7e1d10266 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Jun 15 10:49:53.639949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1263/2631] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:54.216008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:54.216672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:54.223313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.223747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.224501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.224929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.287540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:54.295831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b6a6c926-24a5-44b1-a69a-057ae347ae88 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084032 Jun 15 10:49:54.296403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1369/2632] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:54.315656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:54.316573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:54.323462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.323908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.324660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.325118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.356769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c47b3a0-127c-4a26-8c45-a11fc733cf58 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Jun 15 10:49:54.357378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1264/2633] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:54.652193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:54.653133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:54.659230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.659662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.660414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:54.660839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:54.678049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:54.692380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-665cf777-1ffb-4e68-9193-23c164f2f083 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Jun 15 10:49:54.694589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1370/2634] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:55.312809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:55.313448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:55.319569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.320137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.320768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.322088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.368305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:55.369673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:55.376521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.376981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.377748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.378221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.385873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:55.393534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-33bd24de-0ca8-4108-a8c4-f34f54f3dbe0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084700 Jun 15 10:49:55.394102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1265/2635] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:55.411027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ef4642d4-4fe3-435a-8532-aebdac4e93af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 Jun 15 10:49:55.411593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1371/2636] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:55.704231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:55.705183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:55.711268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.712342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.713488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:55.713923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:55.744051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a0a30b31-be91-4850-9b45-918ab40dcb67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Jun 15 10:49:55.744620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1266/2637] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:56.411371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:56.411998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:56.419514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.419958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.420751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.421217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.421920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:56.422836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:56.429337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.429785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.431205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.431736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.462858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-944a94dd-1e29-494b-b553-62818b485975 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Jun 15 10:49:56.463453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1267/2638] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:49:56.487369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:56.495776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7ee9af1-d8b8-4119-abf2-cfb089c7bb0a tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088189 Jun 15 10:49:56.496351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1372/2639] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:56.755885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:56.756811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:56.763222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.763669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.764438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:56.764873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:56.799237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b8c11cc-ada6-4ec3-b6be-b70b880869e4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047338 Jun 15 10:49:56.799830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1268/2640] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:57.475353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:57.476260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:57.484279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.484790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.485572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.485999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.513581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:57.514308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:57.517731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70f4cfaf-dee1-4ab0-9a63-669a3fed99e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046828 Jun 15 10:49:57.518304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1373/2641] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:57.521082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.521529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.522309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.522741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.590089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:57.597635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fecab0d7-6403-4903-a580-81285ad10259 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089373 Jun 15 10:49:57.598215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1269/2642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:49:57.811611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:57.812439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:57.818526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.818967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.819719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:57.820149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:57.849671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3dd9b3ca-e7a6-464e-8e4f-702e8bb548cf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042021 Jun 15 10:49:57.850226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1374/2643] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:58.530953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:58.531879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:58.538619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.539086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.540439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.540439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.569194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8cfc05d-87de-49df-946d-2cd1dbbb6cf5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jun 15 10:49:58.569744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1270/2644] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:58.614628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:58.615239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:58.621992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.622437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.623192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.623626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.684075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:58.691717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1421416-d968-405c-b512-c90fab91e265 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.080864 Jun 15 10:49:58.692280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1375/2645] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:58 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:58.862060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:58.862874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:58.869561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.869999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.870758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:58.871182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:58.900844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2cc48b28-856d-4623-880c-13f64427c177 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042697 Jun 15 10:49:58.901416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1271/2646] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:59.581480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:59.582396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:59.589161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.589843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.590598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.591024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.620500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa310260-1043-4a73-ac86-e56b59b042d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 Jun 15 10:49:59.621171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1376/2647] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:49:59.708798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:59.709439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:59.717141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.717585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.718335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.718763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.779436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:49:59.787024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bdaa70e9-8955-4dc2-93fe-81548a45edb9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082077 Jun 15 10:49:59.787613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1272/2648] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:49:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:49:59.911981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:49:59.912815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:49:59.919648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.920094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.920857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:49:59.921313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:49:59.951323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-112c1047-4fd0-407c-8607-c7e689f937df tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Jun 15 10:49:59.951883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1377/2649] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:49:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:00.632086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:00.633024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:00.639756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.640198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:00.640946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.641404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:00.658890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:00.671630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f71524e-e3ad-4e9c-9ace-be5e14d1c9ed tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043429 Jun 15 10:50:00.679319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1273/2650] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:00.804785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:00.806063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:00.812440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.812893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:00.813682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.814114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:00.876746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:00.884424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-86e3364b-0b51-4acb-b8ac-aa505f29c7cf tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083441 Jun 15 10:50:00.885001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1378/2651] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:00.963468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:00.964374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:00.971144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.971589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:00.972343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:00.972783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:01.002294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-01d45537-838f-4d24-8bc4-67fae17627de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Jun 15 10:50:01.002843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1274/2652] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:01.688074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:01.688920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:01.694995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:01.695437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:01.696412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:01.696849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:01.725398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-246733cc-590f-4ff7-bc78-feaf651da110 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Jun 15 10:50:01.725944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1379/2653] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:01.901873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:01.902479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:01.908618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:01.909090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:01.909841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:01.910267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:01.975150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:01.983209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ff35da3-0381-4f75-89d9-5d271f6d9cf0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085843 Jun 15 10:50:01.983773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1275/2654] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:02.014097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:02.015003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:02.021394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:02.021836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:02.022580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:02.023004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:02.053838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df481f2d-ddc3-4728-8492-9f41b32b9596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Jun 15 10:50:02.054386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1380/2655] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:02.738988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:02.739905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:02.745992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:02.746430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:02.747208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:02.747611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:02.777366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3ccbd000-3985-44aa-a1ac-c5547281f487 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042349 Jun 15 10:50:02.777931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1276/2656] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:03.000061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:03.000686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:03.006836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.007278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.008023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.009613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.065650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:03.066566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:03.073374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:03.073859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.074033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.075006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.075446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.082743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc59d302-dabe-4c44-9b22-630669bcd6ca tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086354 Jun 15 10:50:03.083420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1381/2657] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:03.108222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bdd58720-60f4-47c3-8d9e-cd380334bf3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Jun 15 10:50:03.109978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1277/2658] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:03.789794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:03.790844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:03.797215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.797667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.798469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:03.798903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:03.831281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d61a8d22-ab85-4f77-ad67-2c85c06693bb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Jun 15 10:50:03.831907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1382/2659] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:04.100830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:04.101398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:04.108528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.109000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.109771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.110208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.120087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:04.121017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:04.127419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.127861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.128609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.129116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.161325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b872c4e0-4f98-4a00-aab2-a831df8f93f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045572 Jun 15 10:50:04.161961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1383/2660] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:04.173272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:04.180855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d965d70-5ac6-4d27-91af-d80ec1d9ccc0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084005 Jun 15 10:50:04.181441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1278/2661] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:04.844025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:04.844897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:04.850982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.851427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.852923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:04.853381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:04.882311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d0f8cda7-6fe9-4535-a23b-8a9077bea7c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jun 15 10:50:04.882875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1384/2662] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:05.173953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:05.174829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:05.182640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.183095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.183859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.184327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.198183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:05.198807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:05.205310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.205753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.206511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.206942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.216160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-554c35e2-cf27-4522-9dba-3a38a25d3667 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Jun 15 10:50:05.216740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1279/2663] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:05.274116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:05.281684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-da4f6de2-c02a-4277-9c7f-471d78078cb6 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087476 Jun 15 10:50:05.282247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1385/2664] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:50:05.894061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:05.894917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:05.901927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.902369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.903112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:05.903539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:05.932834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41d1a302-dadd-41f3-b5f9-a28859cdaeda tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042732 Jun 15 10:50:05.933408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1280/2665] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:05 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:06.227925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:06.228848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:06.235758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.236207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.237001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.237444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.269495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e0a15e56-53fa-4db4-b055-dd487fbc8c9d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Jun 15 10:50:06.270048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1386/2666] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:06.298679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:06.299283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:06.306586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.307029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.307783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.308213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.370004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:06.379137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c163209-190d-4fbd-af00-99a6a2c6c142 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084198 Jun 15 10:50:06.379694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1281/2667] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:06.944354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:06.945244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:06.951646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.952096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.952863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:06.953328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:06.957165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:06.986353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4f899b9-688d-4f32-b710-562829a9ed51 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 Jun 15 10:50:06.986945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1387/2668] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:07.281943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:07.282918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:07.289780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:07.290310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:07.291110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:07.291556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:07.323405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-297ba1da-9a7f-4dfe-81f5-77241960c6a5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Jun 15 10:50:07.324057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1282/2669] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:07.396148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:07.396752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:07.404710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:07.405186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:07.405949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:07.406376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:07.471215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:07.479521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84d60a08-d01d-447a-b90e-b2cd79d8f244 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087337 Jun 15 10:50:07.480089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1388/2670] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:07.998755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:07.999685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:08.005658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.006098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.006845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.007310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.036816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9770ad9-b38d-4c20-b102-e83ee4a17750 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042100 Jun 15 10:50:08.037397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1283/2671] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:08.336629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:08.337707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:08.344006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.344445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.345216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.345647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.378633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0af380cf-cb5b-48e5-a2a4-1a38d1254e75 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Jun 15 10:50:08.379196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1389/2672] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:08.497328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:08.497938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:08.508646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.509478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.510852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:08.511647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:08.595154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:08.604465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25496b4f-b09d-46b7-b91e-6c5d55599c39 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.111333 Jun 15 10:50:08.607787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1284/2673] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:09.047985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:09.048993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:09.055701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.056165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.057000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.057436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.090221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f07e9ca8-bf75-4095-b5c0-54da4b5c3faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Jun 15 10:50:09.090810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1390/2674] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:09.390579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:09.391508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:09.398100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.398724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.400173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.400760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.435396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ce2f59e-1464-496b-abb4-d0e91fcc4427 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049036 Jun 15 10:50:09.435969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1285/2675] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:09.621759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:09.622285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:09.628442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.628890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.629684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:09.630118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:09.671593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:50:09.671851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 (ip 10.222.0.60) !!! Jun 15 10:50:09.693482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:09.702190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e360079-ec57-43d2-ba62-b5e236014203 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084458 Jun 15 10:50:09.702761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1391/2676] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:09 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:10.102213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:10.103162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:10.109815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.110269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.111032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.111493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.141379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc740597-7da6-45f5-840e-2e587949f2b1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 Jun 15 10:50:10.141928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1286/2677] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:10.447504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:10.448326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:10.455343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.455787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.456552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.456996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.489245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f8cb2fa4-8350-4caf-98ea-f3fb2e46cebe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Jun 15 10:50:10.489803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1392/2678] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:10.718949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:10.719558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:10.726526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.727277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.728058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:10.729823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:10.794351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:10.802227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f5095a7-8051-40a9-8154-9f6e122f490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087441 Jun 15 10:50:10.802796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1287/2679] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:11.153652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:11.154574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:11.160744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.161221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.161992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.162422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.192851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e21a305-035c-4c6f-a97e-9f646831ee80 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Jun 15 10:50:11.193450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1393/2680] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:11.502493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:11.503419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:11.512066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.512606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.513498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.514028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.546382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-716755c3-0dd8-4113-8e36-9581b1d38e25 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047940 Jun 15 10:50:11.548051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1288/2681] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:11.820022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:11.820692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:11.827942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.828382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.829173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:11.829599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:11.894944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:11.902772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c360c60-7276-4b5a-ac91-36890905eee4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086681 Jun 15 10:50:11.903343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1394/2682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:12.204754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:12.205739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:12.211960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.212402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.213220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.214192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.245559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4a0a382-ea5e-4c0b-ac68-95c0bfeb308e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Jun 15 10:50:12.246146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1289/2683] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:12 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:12.558932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:12.559855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:12.565990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.566437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.567227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.567656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.602274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-45062852-a391-4889-9786-f76155f0d412 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047972 Jun 15 10:50:12.602850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1395/2684] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:12.920186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:12.920738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:12.927247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.927686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.928440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:12.928866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:12.933071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:12.991479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:12.999790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29971163-6e83-4eda-83fd-6c418e252c33 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083866 Jun 15 10:50:13.005187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1290/2685] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:13.257847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:13.258997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:13.266368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:13.266809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:13.267573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:13.268001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:13.299980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f797c56-e54b-4a1b-bbfa-866f42457620 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Jun 15 10:50:13.300933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1396/2686] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:13.614002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:13.614925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:13.622954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:13.623400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:13.624173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:13.624602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:13.657191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d85a8bd2-97d3-4df5-b03a-4e566b4548f7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Jun 15 10:50:13.657763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1291/2687] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:14.017689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:14.018295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:14.025245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.025670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.026927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.027356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.098277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:14.106364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-881509f4-69ff-4556-b37a-69ec9234326b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.092544 Jun 15 10:50:14.106920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1397/2688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:14.311393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:14.312309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:14.319045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.319487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.320294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.320718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.350757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32fa63e6-6eb1-40fb-ad3d-250b5f97c421 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Jun 15 10:50:14.351286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1292/2689] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:14.669193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:14.670075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:14.676173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.676621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.677409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:14.677846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:14.708540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af505abc-7371-4d4a-ad46-766e4b7f88c8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Jun 15 10:50:14.709112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1398/2690] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:15.123772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:15.124385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:15.130497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.130943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.131876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.132313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.197248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:15.205159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3be421ce-e440-457c-88bc-abfb53253c02 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085855 Jun 15 10:50:15.205718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1293/2691] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:15.362479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:15.363418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:15.370741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.371201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.371975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.372418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.403703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b4a779e-b939-464c-9918-3eaf5a99a48d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Jun 15 10:50:15.404181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1399/2692] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:15.720745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:15.721688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:15.728247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.728691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.729519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:15.729954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:15.758999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85e276d0-331b-4043-a444-7843f3cb6384 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042177 Jun 15 10:50:15.759556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1294/2693] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:16.224213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:16.224816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:16.231020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.231295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.232037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.232465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.294768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:16.302756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f1a9fe1-fc37-48d4-b6a4-ec20b6270280 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082556 Jun 15 10:50:16.303322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1400/2694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:16.415137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:16.416055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:16.422751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.423191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.423947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.424376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.454352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-682f0e22-be64-4c7a-84a5-00056ee599fd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Jun 15 10:50:16.454896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1295/2695] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:16.771502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:16.772418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:16.779549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.779993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.780741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:16.781206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:16.812393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c23fef92-7572-4fd5-9c43-5346f109eda9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Jun 15 10:50:16.812856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1401/2696] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:17.320387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:17.321023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:17.328157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.328598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.329382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.329817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.391969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:17.399725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-05e173f4-8316-47ac-bdc1-6d66d9170031 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083212 Jun 15 10:50:17.400444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1296/2697] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:17.466352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:17.467459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:17.473773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.474233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.474989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.475418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.510281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e26df5c-6a8a-4388-b2c0-c92c77a79293 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048058 Jun 15 10:50:17.510841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1402/2698] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:17.824671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:17.825691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:17.835404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.835841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.836630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:17.837127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:17.875548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a3eed484-6fbd-4566-96e3-25a9aef2279d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054419 Jun 15 10:50:17.876142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1297/2699] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:18.418577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:18.419240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:18.425759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.426149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.426895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.427325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.489470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:18.492842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:18.497754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8e93b02-061e-454d-973a-e96d5574e8ff tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082617 Jun 15 10:50:18.498616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1403/2700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:18.522738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:18.523754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:18.530480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.530920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.531830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.532284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.570021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-71e4a059-c378-4332-a3d8-60cfc4b18f35 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051296 Jun 15 10:50:18.570574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1298/2701] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:18.889233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:18.890233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:18.896434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.896881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.897664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:18.898104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:18.927355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-748f4ab3-6d69-4eda-b12e-a70d726b00ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Jun 15 10:50:18.927904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1404/2702] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:19.516224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:19.516743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:19.522807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.523396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.523992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.524422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.581841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:19.582786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:19.586844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:19.590070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.590516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.591274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.591701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.594604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1286ff85-3793-4346-8bd3-b3900f6ab778 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082782 Jun 15 10:50:19.595167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1299/2703] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:19.622459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ea1fdea-0419-47d9-884b-f2b4718e8ba6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Jun 15 10:50:19.623053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1405/2704] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:19.939456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:19.940283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:19.946434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.946874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.947649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:19.948075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:19.978211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42b75e4a-73c3-4059-b5b5-1a53ea077a34 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jun 15 10:50:19.978757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1300/2705] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:20.611915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:20.612529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:20.619107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.619556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:20.620316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.620753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:20.634887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:20.635804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:20.638093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=88 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:20.644043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.644485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:20.645278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.645706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:20.678658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1d3406b-07c1-43be-ba3f-df9f0b31d4cc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 Jun 15 10:50:20.679225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1301/2706] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:20.683515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:20.691717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5de9abcd-aec4-49a1-93ac-c36a4ad40e68 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083847 Jun 15 10:50:20.692266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1406/2707] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:20 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:20.989957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:20.990872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:20.996892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.997366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:20.998129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:20.999427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:21.028233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b714fc5e-b31b-44b0-9f00-2d73b8f982dd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 Jun 15 10:50:21.028796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1302/2708] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:21.690495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:21.691325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:21.698465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:21.698901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:21.699663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:21.700113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:21.709187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:21.709864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:21.717231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:21.717683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:21.719168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:21.719642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:21.731283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f4b94db-fcad-42d3-8ca0-2874420216fb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Jun 15 10:50:21.731845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1407/2709] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:21.788201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:21.796164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1ccd01a-3e38-4403-a96f-8138804fccb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.091923 Jun 15 10:50:21.796749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1303/2710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:50:22.039568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:22.040477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:22.046595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.047266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.048030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.048463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.079982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9db88a46-3197-478a-8077-d839ef5c9036 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Jun 15 10:50:22.080593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1408/2711] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:22.743218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:22.744137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:22.750940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.751382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.752139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.752570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.781475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c5640fc-3f84-4284-bae1-55a03b3a940b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 Jun 15 10:50:22.782114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1304/2712] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:22.812942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:22.813504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:22.815744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=86 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:22.820481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.820919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.821768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:22.822225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:22.889298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:22.897090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e2322f2-7771-42e4-b3c8-7110155cf8c2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088108 Jun 15 10:50:22.897646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1409/2713] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:23.091285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:23.092118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:23.099528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.099970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.100773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.101275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.133604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04059901-b81f-457c-9413-2eabdb1c1e64 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Jun 15 10:50:23.134164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1305/2714] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:23.792876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:23.793719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:23.800421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.800861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.801647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.802082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.832200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f2649a0-1b9c-475d-a3b0-468547b4f7e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Jun 15 10:50:23.832986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1410/2715] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:23.915300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:23.915904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:23.922315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.923614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.924470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:23.924895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:23.988979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:23.992420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:23.996824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-63c6d1ff-740b-4f59-b2a2-8390b85b71e3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085423 Jun 15 10:50:23.997417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1306/2716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:24.146451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:24.147277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:24.153499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:24.153938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:24.154689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:24.155113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:24.183761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4c2eebca-4377-43ed-8509-6c97a1692614 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Jun 15 10:50:24.184308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1411/2717] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:24.845085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:24.846036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:24.852766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:24.853234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:24.853995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:24.854434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:24.884189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c2bbb581-04b4-4118-b3b7-0bad88698ba9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Jun 15 10:50:24.884750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1307/2718] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:25.014744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:25.015463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:25.022460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.022934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.024185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.024614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.087220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:25.096159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e2721bd-f6d4-4784-9684-4b5decfc224b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084756 Jun 15 10:50:25.096725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1412/2719] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:25.195336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:25.196256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:25.202528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.202981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.204235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.204867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.236049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aac7f808-35f9-476c-b907-94b9cf672967 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jun 15 10:50:25.236623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1308/2720] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:25.895553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:25.896390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:25.902510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.902951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.903702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:25.904130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:25.933923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56f36fb5-a62d-4b41-946a-1f3d62055199 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 Jun 15 10:50:25.934462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1413/2721] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:26.113015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:26.113629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:26.120151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.120610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.121402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.121838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.187326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:26.195118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1bcf9d0b-984a-496d-8bf0-078305bcc67c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086063 Jun 15 10:50:26.195681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1309/2722] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:26.247328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:26.248263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:26.255434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.255995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.256631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.257087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.288407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8174ecda-698e-459b-972e-797d09d1cb66 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Jun 15 10:50:26.288407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1414/2723] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:26.945594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:26.946430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:26.952518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.952987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.954035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:26.954477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:26.983964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18103e0d-597a-4cff-bda2-b1a501129692 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Jun 15 10:50:26.984475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1310/2724] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:27.212716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:27.213365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:27.219753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:27.221624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:27.222390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:27.222819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:27.284896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:27.292535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73ed8046-9421-40ec-a78d-efc3921b80c3 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083657 Jun 15 10:50:27.293307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1415/2725] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:27.300067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:27.301008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:27.307658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:27.308028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:27.308833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:27.309301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:27.339204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19126b2f-3f86-4416-a0c7-7f030932c50c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Jun 15 10:50:27.340027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1311/2726] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:27.996190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:27.997242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:28.004069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.004513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.005297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.005730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.035544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6f8f9d63-3260-4cdc-95cd-205621173dfe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043268 Jun 15 10:50:28.036094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1416/2727] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:28.310467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:28.311053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:28.319447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.319913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.320788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.321251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.355010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:28.356448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:28.365603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.366176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.367048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:28.367577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:28.394406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:28.401486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03172415-3ddf-4566-b293-5a5595526a97 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053198 Jun 15 10:50:28.402054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1417/2728] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:28.402356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2750fe2-44a7-4aba-a73f-6d4b6e471104 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.096328 Jun 15 10:50:28.402921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1312/2729] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:29.047107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:29.048622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:29.054725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.055171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.055922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.056352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.085389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b3b3cc3-d909-42c1-b94e-700ef0fb08e0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Jun 15 10:50:29.085933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1418/2730] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:29.413456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:29.414401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:29.419712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:29.420328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:29.421024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.421468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.422234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.422662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.427530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.427978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.428768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:29.429253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:29.454338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb07e559-68fd-46ad-a1d9-5a372e53881d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Jun 15 10:50:29.455604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1313/2731] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:29.492986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:29.501056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1dbe99d4-2a9b-43c1-8da2-cc7c0927b8c4 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085241 Jun 15 10:50:29.502236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1419/2732] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:30.209839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:30.210748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:30.217102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.217546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.218337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.218772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.250306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0b3bea7c-3830-4305-ab81-910ce7722584 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157023 Jun 15 10:50:30.250861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1314/2733] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:30.519428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:30.520135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:30.526452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.526884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.527645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.528082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.585964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:30.586989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:30.592886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:30.593465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.593921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.594681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:30.595671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:30.601428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-628ff67d-8292-4cfd-89b3-ecaa8d81fa27 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086399 Jun 15 10:50:30.602302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1315/2734] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:50:30.613208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:30.625885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1fb2c48b-d9e3-4aee-91be-268f7c75983a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163293 Jun 15 10:50:30.627221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1420/2735] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:31.263587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:31.264715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:31.271913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.272356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.273144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.273585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.304686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1471d76a-edd3-4fd4-933d-cff93663e524 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045169 Jun 15 10:50:31.305290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1316/2736] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:31 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:31.619508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:31.620139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:31.626869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.627342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.628103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.628529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.638040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:31.638944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:31.645952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.646390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.647137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:31.647750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:31.679971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34afc439-1f8e-4a9c-9756-20254ed49b77 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045657 Jun 15 10:50:31.680524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1317/2737] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:31.693512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:31.701133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e7b4c628-8488-4da7-a2e5-fc36f6659881 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085856 Jun 15 10:50:31.701688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1421/2738] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:31 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:32.132047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:50:32.132352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:50:32.315736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:32.316645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:32.322820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.323310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.324060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.324492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.355087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-79c24426-4faf-4556-b1ea-24e136b09bc8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Jun 15 10:50:32.355627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1318/2739] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:32.692283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:32.693223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:32.699998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.700451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.701222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.701659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.719284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:32.720159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:32.726857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.727299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.728063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:32.728489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:32.733009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-527973f7-cc63-4167-82e4-f6d7a60135e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Jun 15 10:50:32.733576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1422/2740] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:32.794424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:32.802700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-347670c6-faa0-4980-913d-4e7975db22b5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087306 Jun 15 10:50:32.803277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1319/2741] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:50:33.366472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:33.367417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:33.373827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.374282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.375086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.375520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.408808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-11eaedbd-1383-4c54-9b54-ac45c2be8d69 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046223 Jun 15 10:50:33.409421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1423/2742] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:33.743955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:33.744876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:33.751747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.752345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.753159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.753599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.782132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a7484c4-8a1b-49ee-9d1f-3115bcdbd26d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 Jun 15 10:50:33.783191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1320/2743] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:33.819547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:33.820154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:33.826852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.827297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.828059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:33.828522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:33.889804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:33.898418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d707628e-8d4b-45bd-8cd0-ecc0ddb361e9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082698 Jun 15 10:50:33.898976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1424/2744] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:34.420348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:34.421300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:34.427966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.428414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.429204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.429637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.459110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64de606e-7800-41f1-8191-3cf522b698c0 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042528 Jun 15 10:50:34.459672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1321/2745] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:34.794580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:34.795501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:34.802212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.802661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.803419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.803878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.834041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2003b8ca-30da-4018-9d2d-6d0ec4d7a8c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Jun 15 10:50:34.834713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1425/2746] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:34.916463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:34.917093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:34.923894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.924323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.925114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:34.925539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:34.986410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:34.993854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75affa86-3eb5-4db9-9584-44a0e0d9f607 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081279 Jun 15 10:50:34.994405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1322/2747] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:35.471857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:35.472769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:35.479064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:35.479508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:35.480269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:35.480696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:35.510926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dbf632e9-7187-4218-87df-efbe71f3825e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jun 15 10:50:35.511472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1426/2748] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:35.845803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:35.846714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:35.852900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:35.853367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:35.854117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:35.854545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:35.872495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:35.886103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56080b0a-2f3f-41e6-a815-5aa9f9edeab2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Jun 15 10:50:35.889135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1323/2749] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:36.011579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:36.012180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:36.019630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.020079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.020827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.021293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.082034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:36.090413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-678835e8-75a2-4862-a2d6-f5d6d162fb0e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082946 Jun 15 10:50:36.090976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1427/2750] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:36 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:36.523408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:36.524344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:36.531658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.532103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.532873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.533334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.564512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-66ac1878-f7fe-4927-ad83-55dfdf8e4e05 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Jun 15 10:50:36.565542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1324/2751] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:36.899619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:36.900442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:36.906629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.907068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.907814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:36.908240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:36.939070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee2e5a5e-2147-4057-af7c-ea58bf4a1b3d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Jun 15 10:50:36.939610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1428/2752] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:37.107606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:37.108201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:37.114493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.114931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.115683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.116117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.176944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:37.184496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2381793f-4def-41cc-a7ba-e91560d925fc tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.080708 Jun 15 10:50:37.185073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1325/2753] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:37 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:37.576409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:37.577350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:37.584692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.585169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.585934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.586368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.617718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f2cb96f-444d-4bde-a6e0-bfe721e278b8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Jun 15 10:50:37.618289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1429/2754] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:37.951205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:37.952166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:37.960550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.961023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.961790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:37.962225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:37.991909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f554ecad-f3ba-434f-9fd7-b72777da1ab6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Jun 15 10:50:37.992460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1326/2755] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:37 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:38.202172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:38.202726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:38.209702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:38.210144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:38.210900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:38.211359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:38.274111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:38.281857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-076927cf-00e0-4907-9a66-195fcd594148 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083576 Jun 15 10:50:38.282489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1430/2756] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:38 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:38.630691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:38.631603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:38.637656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:38.638080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:38.638832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:38.639259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:38.668812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bca7b883-5ade-4e3c-a60d-77f45c99b813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jun 15 10:50:38.669398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1327/2757] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:39.003582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:39.005057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:39.011558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.012000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.012749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.013200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.043939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-885f9329-721e-4582-86be-353526f0a492 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Jun 15 10:50:39.044487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1431/2758] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:39.298159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:39.298698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:39.305501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.305944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.306800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.307233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.369432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:39.376919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d0bc9a0-bc02-4bd2-859d-5c3a3ca3eb09 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082684 Jun 15 10:50:39.380978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1328/2759] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:39 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:39.680215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:39.681108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:39.688031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.688487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.689355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:39.689795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:39.721720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7bb616a4-fedf-4897-b260-d325a59835f9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Jun 15 10:50:39.722274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1432/2760] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:40.056287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:40.057222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:40.063298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.063743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.064500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.064932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.095077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7d0f1df-0889-49bd-bd37-768c4a5c6e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Jun 15 10:50:40.095625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1329/2761] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:40.395100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:40.395657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:40.402564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.403007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.403789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.404214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.469814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:40.478738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1cf268c1-fa05-49f5-94db-269d31306d72 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087594 Jun 15 10:50:40.479298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1433/2762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:40 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:40.734114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:40.735060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:40.744070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.744532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.745335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:40.745796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:40.776947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c857144-abaa-46c8-acbf-88ccf9d1b3d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Jun 15 10:50:40.777533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1330/2763] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:41.106778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:41.107632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:41.113680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.114119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.114866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.115288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.144482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d51ec2e8-1bd6-4b55-8904-9d6bd58035b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Jun 15 10:50:41.145050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1434/2764] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:41.496737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:41.497376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:41.504378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.504823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.505622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.506055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.574622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:41.582301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3b8e5ef-8faf-44fb-8357-98d76eb2c7ae tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089982 Jun 15 10:50:41.582858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1331/2765] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:41 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:41.789388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:41.790206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:41.796754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.797225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.797978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:41.798408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:41.829948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f9159062-beab-4e70-abe0-1675118ffecd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Jun 15 10:50:41.830518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1435/2766] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:42.157059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:42.157909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:42.165322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.165778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.166546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.166977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.196813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8eeea8df-8f62-41f0-b034-fc46898d236d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Jun 15 10:50:42.197408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1332/2767] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:42.599940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:42.601134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:42.607306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.607750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.608510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.609071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.671457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:42.681104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fdf36d46-b6eb-4be2-9692-ad16b14dfa87 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084907 Jun 15 10:50:42.681678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1436/2768] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:42 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:42.842047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:42.842871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:42.848991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.849436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.850186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:42.850710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:42.881482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9e19fe4-60ae-4317-997f-a57e88a507e2 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jun 15 10:50:42.882711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1333/2769] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:43.208110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:43.209076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:43.216614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.217100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.217862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.218289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.221989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:43.247727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f9b0d4a-e220-4a34-9337-c419605fe10b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Jun 15 10:50:43.248292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1437/2770] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:43.699248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:43.699853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:43.706348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.706793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.707543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.707970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.773468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:43.781238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba5c0aeb-1023-46c9-97ea-af459331f493 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086510 Jun 15 10:50:43.781801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1334/2771] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:43 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:43.894250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:43.895241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:43.902597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.903073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.903844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:43.904276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:43.933587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e44f97b6-bd92-41fc-a2a7-923ba9e65d32 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Jun 15 10:50:43.934145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1438/2772] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:44.260212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:44.261173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:44.267560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.268002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.268762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.269222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.298891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-089fdaea-e6a2-4016-8835-077edc03954d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Jun 15 10:50:44.299445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1335/2773] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:44.798834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:44.799376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:44.806376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.806811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.807554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.807979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.870439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:44.878223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-118a6790-e4e3-417b-ba39-8ae5afc9091e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083263 Jun 15 10:50:44.878789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1439/2774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:44 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:44.945671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:44.946583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:44.953148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.953596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.954347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:44.954776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:44.984575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24b48f18-acfc-4d36-968f-fd7f03bb77d1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042932 Jun 15 10:50:44.985149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1336/2775] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:45.310620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:45.311535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:45.317686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:45.318139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:45.320272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:45.320272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:45.351304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f200de29-4f62-47d3-b332-6541ec76a571 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jun 15 10:50:45.351736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1440/2776] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:45.895652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:45.896284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:45.902881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:45.903327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:45.904132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:45.904572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:45.967705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:45.975553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04f85c7d-0676-4c39-8ce6-b51d95aaf8a2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083845 Jun 15 10:50:45.976258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1337/2777] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:45 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:45.996304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:50:45.997232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:46.003875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:46.019272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:46.019272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:46.019272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:46.105987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8ae2ce5e-3b6d-473f-9b52-8623411bfcb3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action" status: 200 len: 115773 microversion: 2.1 time: 0.113394 Jun 15 10:50:46.106669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1441/2778] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:50:45 2022] POST /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d/action => generated 115773 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:50:46.362395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:46.363367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:46.370281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:46.370719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:46.371476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:46.371903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:46.403170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94c69093-04f7-4e82-9743-f27c293d492c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Jun 15 10:50:46.407174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1338/2779] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:46.993408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:46.994111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:47.001282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:47.001982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:47.002473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:47.002906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:47.067154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:47.076060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c7d85c04-cc4c-4e09-999d-53b0279ea98e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086948 Jun 15 10:50:47.076618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1442/2780] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:46 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:50:47.415996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:47.416913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:47.423557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:47.423998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:47.424755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:47.425216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:47.456430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f716abf9-6917-456c-994f-54153e1fa8c6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Jun 15 10:50:47.456890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1339/2781] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:47 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:48.094069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:48.094664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:48.101982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:48.102418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:48.103204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:48.103641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:48.169310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:48.176922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a66037b0-9c83-426b-b070-a1d88f57f46b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086950 Jun 15 10:50:48.177513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1443/2782] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:48 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:48.468271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:48.469231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:48.475918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:48.476366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:48.477201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:48.477666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:48.481504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:48.507736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab3eb4ac-35bb-41a6-b314-c4362c2f4788 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Jun 15 10:50:48.508293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1340/2783] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:49.194503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:49.195753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:49.202635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:49.203128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:49.203941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:49.204366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:49.267444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:49.275272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-98af463b-f8ef-4bcc-9f56-4dcf39d80f9c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084617 Jun 15 10:50:49.275835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1444/2784] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:49 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:49.519916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:49.520913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:49.528602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:49.529153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:49.529907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:49.530335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:49.561875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1bf83bd-a811-482e-9de8-a3a1eec91816 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 Jun 15 10:50:49.562427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1341/2785] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:50.178193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:50:50.178583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:50:50.292203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:50.292807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:50.299358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:50.299793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:50.300545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:50.301061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:50.365072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:50.372852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1124adc2-1186-4cee-bad6-9bdf032e4d2c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084455 Jun 15 10:50:50.373447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1445/2786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:50 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:50.574526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:50.575442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:50.581973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:50.582419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:50.583178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:50.583610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:50.613754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3e3fd61a-39e8-4bb5-8dfd-b822db488c9c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Jun 15 10:50:50.614298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1342/2787] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:51.390226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:51.390819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:51.397412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:51.397843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:51.398585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:51.399011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:51.462390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:51.470382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc3ce870-047e-4d23-ba8b-d8a1a22acb5b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083950 Jun 15 10:50:51.470939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1446/2788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:51 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:51.625805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:51.626636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:51.628986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:51.633876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:51.634349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:51.635111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:51.635544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:51.664787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-104dded4-7239-40e1-8428-d26b8f2cbc78 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Jun 15 10:50:51.666143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1343/2789] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:52.488609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:52.489255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:52.497073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:52.497549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:52.498302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:52.498731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:52.563308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:52.570994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3c461c6-b3c4-4fa3-88e2-55fa98de55d2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086276 Jun 15 10:50:52.572915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1447/2790] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:52 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:52.677481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:52.678406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:52.686249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:52.686685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:52.687438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:52.687862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:52.720270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07026602-605d-46d3-8050-f359c0d84b21 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Jun 15 10:50:52.720811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1344/2791] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:53.589325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:53.590131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:53.593574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=78 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:50:53.599079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:53.599079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:53.599079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:53.599079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:53.660398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:53.669030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a95622b4-e338-4460-a460-e2c242c5bbad tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084104 Jun 15 10:50:53.669605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1448/2792] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:53 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:53.731884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:53.732823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:53.739796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:53.740262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:53.741029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:53.741464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:53.771084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41827e48-c1d2-4fc6-987d-86e09c9acf16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 Jun 15 10:50:53.771634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1345/2793] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:54.687116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:54.687709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:54.694345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:54.694789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:54.695547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:54.696006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:54.757452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:54.765320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-85a1ba7a-4a0c-4baf-bef9-68c3140ff15b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082567 Jun 15 10:50:54.765872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1449/2794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:54 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:54.783906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:54.784828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:54.790835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:54.791304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:54.792697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:54.793101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:54.821588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d6240b4-bfe8-478a-bcb1-558c0f22cb6e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jun 15 10:50:54.822136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1346/2795] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:55.782365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:55.782975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:55.789711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:55.790195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:55.790904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:55.792058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:55.834392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:55.837085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:55.844596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:55.845074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:55.845840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:55.846273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:55.854489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:55.862579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6524f287-f4d4-4ab2-a5ab-105dde448647 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084121 Jun 15 10:50:55.863580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1450/2796] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:55 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:55.877825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-641fb1a5-356b-4d38-bc83-87f4f41300d9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047353 Jun 15 10:50:55.878393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1347/2797] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:56.879827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:56.880486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:56.887929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:56.888440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:56.889232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:56.889662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:56.890248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:56.891201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:56.898256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:56.898712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:56.899579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:56.899910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:56.930189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b44d6c66-890e-4c25-9ad5-c9af1d99a5aa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Jun 15 10:50:56.930755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1348/2798] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:50:56.963540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:56.971334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f106362-ac4e-48f4-b4b8-d3d7cb422c56 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.095514 Jun 15 10:50:56.971882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1451/2799] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:56 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:57.942298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:57.943201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:57.950268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:57.950742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:57.951541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:57.951963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:57.981725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac82c98f-54e2-487c-b402-0133bebc41a0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Jun 15 10:50:57.982270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1349/2800] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:57.988251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:57.988856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:57.995536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:57.995973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:57.996719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:57.997173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:58.169480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:58.169480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a210ccc-7729-43ee-b972-380fa5f8fe99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081187 Jun 15 10:50:58.169480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1452/2801] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:57 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:50:58.993253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:58.994165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:59.001442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:59.001889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:59.002693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:59.003125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:59.032206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57688dba-fa44-42dd-b145-52a1663c95d3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 Jun 15 10:50:59.032764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1350/2802] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:50:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:50:59.083463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:50:59.084068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:50:59.091627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:59.092069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:59.092828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:50:59.093292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:50:59.156063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:50:59.163870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a4056d8-5aa0-4d96-b8e6-eb5635bdfc86 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084259 Jun 15 10:50:59.164430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1453/2803] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:50:59 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:00.043706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:00.044619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:00.051854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:00.052298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:00.053114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:00.053548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:00.082633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-473e45b2-6732-4afd-9244-0b96fb4fec3e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Jun 15 10:51:00.083197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1351/2804] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:00.181913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:00.182527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:00.189355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:00.189807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:00.190566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:00.191002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:00.195051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:00.253082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:00.260870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f045284-0402-4b8b-918b-018fdc1c1fdd tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082963 Jun 15 10:51:00.261451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1454/2805] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:00 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:01.095096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:01.096042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:01.102689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:01.103134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:01.103890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:01.104325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:01.133404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f571e20-23c0-4498-b4cc-a9cd79c83a3b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042781 Jun 15 10:51:01.133962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1352/2806] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:01.279638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:01.280283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:01.287059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:01.287507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:01.288274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:01.288709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:01.352786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:01.360463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d71e62ca-1db3-48ec-aaf4-064631c569aa tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084734 Jun 15 10:51:01.361001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1455/2807] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:01 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:02.147304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:02.148224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:02.154769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:02.155221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:02.155976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:02.157052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:02.187090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b7abccf-7cb0-4a84-bf58-7634e9e55446 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Jun 15 10:51:02.187781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1353/2808] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:02.377574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:02.378219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:02.384754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:02.385225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:02.385979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:02.386412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:02.446760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:02.455443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae3ea44a-5bf3-4798-b569-0cc1fd2b2182 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081804 Jun 15 10:51:02.456007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1456/2809] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:02 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:03.199366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:03.200278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:03.207568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:03.208005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:03.208767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:03.209223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:03.241147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32743d1d-f07c-41a9-9159-43afbf3a0605 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Jun 15 10:51:03.241709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1354/2810] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:03.473189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:03.473979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:03.480982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:03.481426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:03.482245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:03.482685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:03.547627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:03.555696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-206bc4a0-2fbe-47e5-980b-7da14832d2f2 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.087325 Jun 15 10:51:03.556259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1457/2811] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:03 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:04.253433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:04.254358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:04.260932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:04.261403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:04.262160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:04.262588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:04.293755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0ef2d3f-74c7-45ef-9166-ebc94583c443 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Jun 15 10:51:04.294301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1355/2812] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:04.573000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:04.573616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:04.580583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:04.581049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:04.581818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:04.582256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:04.642757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:04.650278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d26519fa-c27c-4a11-80a2-5ec3c0b46933 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081145 Jun 15 10:51:04.650831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1458/2813] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:04 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:05.306018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:05.306934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:05.313518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:05.313943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:05.314741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:05.315172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:05.342363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:05.347620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d21b8af0-22ff-442f-9e5d-69bdee0c4cbe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Jun 15 10:51:05.348181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1356/2814] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:05.667259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:05.667792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:05.674488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:05.674907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:05.675667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:05.676098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:05.742142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:05.749770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5525668b-752e-4bf5-9d30-ad6d07aa2257 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086431 Jun 15 10:51:05.750327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1459/2815] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:05 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:06.358441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:06.359356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:06.366862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:06.367304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:06.368062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:06.368494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:06.397615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25cfa2a3-f5d8-467d-bec5-e2c55398f910 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jun 15 10:51:06.398162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1357/2816] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:06.768194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:06.768909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:06.775598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:06.776042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:06.776802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:06.777296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:06.840355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:06.848543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5169d322-399d-44c8-960c-a1dcda5911c8 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084345 Jun 15 10:51:06.849137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1460/2817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:06 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:07.409235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:07.410158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:07.416808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:07.417302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:07.418063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:07.418499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:07.447589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2833055-1063-4e4c-99d5-1a23b15c676c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 Jun 15 10:51:07.448135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1358/2818] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:07.866061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:07.866651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:07.873398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:07.873843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:07.874601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:07.875033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:07.938036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:07.946175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4c1245c1-8138-465f-88f8-0810b7f69eb5 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083834 Jun 15 10:51:07.946755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1461/2819] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:07 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:08.460792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:08.461745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:08.468422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:08.468859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:08.469664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:08.470097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:08.501393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5f3a67ee-7532-4610-aa23-8385000ad352 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Jun 15 10:51:08.502348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1359/2820] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:08.963335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:08.963990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:08.971484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:08.971925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:08.972699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:08.973160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:09.040239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:09.049270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4039546e-6653-4af6-a246-3bdcd2dcd2de tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089019 Jun 15 10:51:09.056720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1462/2821] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:08 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:09.513511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:09.514421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:09.521359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:09.521802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:09.522585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:09.523016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:09.556162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f1cd748-06a2-4f5c-b4d1-231417f3392f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046471 Jun 15 10:51:09.556731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1360/2822] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:10.072228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:10.072836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:10.079408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:10.080500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:10.081283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:10.081717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:10.145613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:10.153247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d58a903b-46b8-44e6-b8aa-5ea49398bf5d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084761 Jun 15 10:51:10.153807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1463/2823] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:10 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:10.568392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:10.569337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:10.575817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:10.576262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:10.577033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:10.577465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:10.607423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f9b4d485-f420-4697-9215-38be18106462 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Jun 15 10:51:10.607967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1361/2824] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:11.171255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:11.171927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:11.179826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:11.180268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:11.181052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:11.181563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:11.244073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:11.251575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-051dd445-a8b1-423a-a501-3c43124ef396 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084254 Jun 15 10:51:11.252125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1464/2825] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:11 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:11.618653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:11.619557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:11.626310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:11.626746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:11.627706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:11.627920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:11.659241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-de2f6778-76bc-48df-b510-3c6a0c1ff0fb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Jun 15 10:51:11.660464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1362/2826] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:12.269913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:12.270788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:12.277831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:12.278278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:12.279148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:12.279583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:12.342557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:12.350676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7722ae17-b62e-40d0-a958-a6782b06eb3b tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084631 Jun 15 10:51:12.351239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1465/2827] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:12 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:12.671796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:12.672752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:12.679573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:12.680019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:12.680793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:12.681256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:12.710714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e1456ec-f0ae-4d3e-881e-71814d892c42 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jun 15 10:51:12.711277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1363/2828] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:13.367669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:13.368278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:13.375035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:13.375492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:13.376310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:13.376740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:13.439309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:13.447255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f1e6e3c9-d6b7-4a45-98c0-ec4ba9c46e76 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083574 Jun 15 10:51:13.447814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1466/2829] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:13 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:13.722566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:13.727440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:13.730940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:13.731397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:13.732136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:13.732563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:13.763464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c41e1539-ce21-4ad4-9ea2-e1462ba5e596 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Jun 15 10:51:13.764033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1364/2830] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:14.465111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:14.465721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:14.472205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:14.472639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:14.473422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:14.473854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:14.537828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:14.545502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a14fd2f-5a2b-4c16-8fcd-8dac6610be44 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084611 Jun 15 10:51:14.546070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1467/2831] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:14 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:14.775249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:14.776117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:14.782667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:14.783104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:14.783868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:14.784283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:14.815160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b9331530-ed85-4fce-800b-b343bca6e809 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Jun 15 10:51:14.815703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1365/2832] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:15.562116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:15.562737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:15.569966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:15.570433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:15.571292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:15.571664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:15.633561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:15.641123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-892c6210-20ac-41fc-b5c6-7abc661e2d57 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.082880 Jun 15 10:51:15.641659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1468/2833] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:15 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:15.827781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:15.828689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:15.835494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:15.835935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:15.836695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:15.837173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:15.867842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7b854109-da46-447a-b15e-a069d0999466 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Jun 15 10:51:15.868396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1366/2834] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:16.658318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:16.658894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:16.666878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:16.667318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:16.668100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:16.668527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:16.730922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:16.738530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1361be93-e7eb-4e45-ae76-12c6a0fb2dd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084226 Jun 15 10:51:16.739099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1469/2835] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:16 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:16.880897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:16.881884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:16.888630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:16.889212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:16.890246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:16.890683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:16.928713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7446e9c9-1e4a-45ff-9488-517147484c67 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051431 Jun 15 10:51:16.929308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1367/2836] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:17.757021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:17.757654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:17.764640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:17.765137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:17.765907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:17.766339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:17.827814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:17.831275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:17.836543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f65fd23c-de13-4637-bfad-82a63f94b31f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083410 Jun 15 10:51:17.837146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1470/2837] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:17 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:17.939525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:17.940433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:17.947621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:17.948059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:17.948821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:17.949277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:17.980257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2c3b4fe9-8280-44dc-b82b-5f5403310994 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Jun 15 10:51:17.980821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1368/2838] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:18.854906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:18.855489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:18.863211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:18.863852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:18.864950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:18.865625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:18.931785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:18.939532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-715b03fb-d9ca-433c-af53-de12a26998ab tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089468 Jun 15 10:51:18.940082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1471/2839] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:18 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:18.992446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:18.993385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:18.999919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:19.000362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:19.001157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:19.001587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:19.031328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-842bc9ac-c0f1-4240-9646-391ed6fde234 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Jun 15 10:51:19.031880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1369/2840] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:19.957863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:19.958523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:19.966013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:19.966545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:19.967375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:19.967807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:20.033126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:20.040933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70638d0f-0d67-4fdc-ac7f-d7fbf6e675ac tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.086937 Jun 15 10:51:20.041519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1472/2841] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:19 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:20.043054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:20.044017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:20.056848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:20.057327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:20.058089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:20.058519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:20.088104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fafeb25c-6ef2-431c-9ecb-cc59d7df5321 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049055 Jun 15 10:51:20.089112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1370/2842] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:21.057940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:21.058631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:21.065122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:21.065571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:21.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:21.066766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:21.099834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:21.101037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:21.107708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:21.108141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:21.108908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:21.109360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:21.127357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:21.135588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10ea1996-efa7-4716-ae2c-53c2b9b589c0 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081454 Jun 15 10:51:21.136168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1473/2843] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:21 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:21.140354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da547f78-1921-40f3-bddb-3a7184b10042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Jun 15 10:51:21.141024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1371/2844] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:51:22.153209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:22.153913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:22.154165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:22.155084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:22.160580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:22.161058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:22.161538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:22.161830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:22.161975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:22.162271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:22.162730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:22.163156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:22.196473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d7573aa5-badf-4200-bee2-1017f990f530 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048482 Jun 15 10:51:22.197077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1474/2845] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:22.229653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:22.237317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78a8b723-dee1-4768-be53-95d28e3242fe tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.088530 Jun 15 10:51:22.237873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1372/2846] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:22 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:23.207163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:23.208134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:23.215413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:23.215851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:23.216601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:23.217051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:23.247969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c0f1f17-fbf1-4dd2-986e-99e07db08515 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Jun 15 10:51:23.248548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1475/2847] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:23.254022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:23.254630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:23.256908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=60 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:23.262429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:23.262879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:23.263646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:23.264078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:23.282422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:23.325913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:23.333668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-93167186-b143-45e5-9dfc-e33b1f1d303f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083383 Jun 15 10:51:23.334220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1373/2848] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:23 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:24.260448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:24.261387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:24.267899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:24.268339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:24.269119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:24.269547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:24.298972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ad9c5fe-91e5-463b-8282-6b7818c492d2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Jun 15 10:51:24.299527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1476/2849] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:24.351743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:24.352295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:24.358531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:24.358976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:24.359729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:24.360163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:24.419998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:24.427492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc8e7fd9-1dba-4840-b3f2-e60ca193a92e tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.079888 Jun 15 10:51:24.428059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1374/2850] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:24 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:25.309957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:25.310868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:25.313540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=58 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:25.318597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:25.319043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:25.319818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:25.320335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:25.352263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b8d95f0a-eede-426a-9771-19166dd38918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Jun 15 10:51:25.352820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1477/2851] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:25.446343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:25.446987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:25.458762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:25.459210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:25.459991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:25.460422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:25.522593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:25.531093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50d74cdc-c73a-4a7f-8719-d61b18612cd1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.089854 Jun 15 10:51:25.531654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1375/2852] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:25 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:26.364156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:26.365093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:26.372136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:26.372579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:26.373367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:26.373802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:26.402310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4051e535-c934-4d87-9ec3-7ffc3d1b0c1c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Jun 15 10:51:26.402856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1478/2853] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:26.547712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:26.548327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:26.554882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:26.555318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:26.556085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:26.556517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:26.620364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:26.627976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a6fd4c7-4676-4af2-af0b-a755ac0f16d1 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084132 Jun 15 10:51:26.628535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1376/2854] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:26 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:27.414261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:27.415178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:27.421766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:27.422203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:27.422947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:27.423375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:27.453315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2dd099d8-7643-4edf-b389-df197a76cf2c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Jun 15 10:51:27.453859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1479/2855] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:27.644639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:27.645283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:27.652169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:27.652598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:27.653378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:27.653805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:27.716724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:27.724253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0df9016-c593-4d77-bce0-4e00d5ff58a7 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.083830 Jun 15 10:51:27.724804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1377/2856] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:27 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:28.466712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:28.467644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:28.474222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:28.474661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:28.475409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:28.475840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:28.506614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6cb492fa-7267-4d30-b35c-dcfd0d3421de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Jun 15 10:51:28.507165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1480/2857] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:28.741961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:28.742485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:28.749301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:28.749746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:28.750500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:28.750929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:28.811293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:28.818673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7bb71a56-7417-4afd-9ee2-e9328a0d2b66 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.080798 Jun 15 10:51:28.819221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1378/2858] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:28 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:29.517932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:29.518840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:29.526559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:29.526997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:29.527764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:29.528192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:29.558367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-516109e6-c4d0-4804-8a20-c3f90098ca95 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Jun 15 10:51:29.558922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1481/2859] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:51:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:51:29.836615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:29.837332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:29.844017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:29.844459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:29.845246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:29.845679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:29.908755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:29.916442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e5c39d5-6fb4-4d10-addd-9c7caaa54d99 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084159 Jun 15 10:51:29.917021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1379/2860] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:29 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:30.571104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:51:30.572004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:30.578516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:30.578956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:30.579703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:30.580128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:30.671232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc22f01d-3925-4207-aaa7-33b1f4db509b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action" status: 200 len: 76399 microversion: 2.1 time: 0.104327 Jun 15 10:51:30.671903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1482/2861] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 10:51:30 2022] POST /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199/action => generated 76399 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:51:30.934070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:30.934621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:30.941036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:30.941484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:30.942276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:30.942708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:31.006076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:31.014462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf91fe8e-e029-442c-b2cb-89e4924c115c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084315 Jun 15 10:51:31.015019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1380/2862] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:30 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:32.032761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:32.033511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:32.041183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:32.041629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:32.042385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:32.042815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:32.104842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:32.112801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-503211a2-08f8-4287-9cbf-f9813df4e86d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.084435 Jun 15 10:51:32.113369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1483/2863] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:32 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:33.129703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:33.130291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:33.136975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:33.137425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:33.138179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:33.138612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:33.200016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:33.207895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e679cdc-791a-4aa5-b63f-f4538108b8b9 tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.081924 Jun 15 10:51:33.213714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1381/2864] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:33 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:34.225187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:34.225788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:34.232885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:34.233352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:34.234135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:34.234561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:34.455668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:34.463928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-eb99a469-600b-40e6-9850-70a8ade2490f tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.242598 Jun 15 10:51:34.464481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1484/2865] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:34 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:35.481953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:35.482616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] [instance: 900487d3-db1b-4eee-8345-bdbe9e61a352] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:35.489316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:35.489764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:35.490516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:35.490948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:35.556268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abbf3822f4a6415b964112a383ad5509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492be26275404bc3a439ae049bf4b9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:35.563749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4bed885d-47fd-46fd-9e6c-1903f574078d tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352" status: 200 len: 1219 microversion: 2.1 time: 0.085809 Jun 15 10:51:35.564306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1382/2866] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:35 2022] GET /compute/v2.1/servers/900487d3-db1b-4eee-8345-bdbe9e61a352 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:35.844068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a5bcc73-26ed-492b-899e-e682ef1c3a0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] Calling method '.version_select at 0x7fc27df389d0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:35.919804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a5bcc73-26ed-492b-899e-e682ef1c3a0c tempest-TestShelveInstance-314891931 tempest-TestShelveInstance-314891931-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1109776199" status: 202 len: 0 microversion: 2.1 time: 0.079921 Jun 15 10:51:35.920371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1485/2867] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Jun 15 10:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1109776199 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:51:37.564138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:37.564705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:37.572392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:37.572832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:37.573895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:37.574328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:37.612784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:51:37.618963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:37.620049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:37.628289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:37.629315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:37.631042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:37.631945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:37.665108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:51:37.984156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-42d9dbe9-d23c-40db-b9ab-d336d78df51c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 204 len: 0 microversion: 2.20 time: 0.369856 Jun 15 10:51:37.987913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1486/2868] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Jun 15 10:51:37 2022] DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:51:37.989734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd7dd791-f256-4e83-acb3-90ec4ba82ebc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 204 len: 0 microversion: 2.1 time: 0.424509 Jun 15 10:51:37.991220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:37.992099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:37.995519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1383/2869] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:51:37 2022] DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:51:38.003352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52b875b1-4e82-4e87-a1c7-6b2017058dd1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] Calling method '.version_select at 0x7fc27979ab80>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:38.011965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.014359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.014359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.014359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.023751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:38.049248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:51:38.091913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52b875b1-4e82-4e87-a1c7-6b2017058dd1 tempest-TestVolumeBootPattern-1319200504 tempest-TestVolumeBootPattern-1319200504-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1780355668" status: 202 len: 0 microversion: 2.1 time: 0.095110 Jun 15 10:51:38.092526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1384/2870] 10.222.0.60 () {58 vars in 1262 bytes} [Wed Jun 15 10:51:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1780355668 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:51:38.097814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:38.099629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:38.109277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.109730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.110509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.110947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.358407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3fc36ba4-a15e-4414-900d-d147fd3b39cc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 204 len: 0 microversion: 2.1 time: 0.371199 Jun 15 10:51:38.358992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1487/2871] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:51:37 2022] DELETE /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:51:38.364147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:38.365577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:38.376161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.376756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.380058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.380729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.404354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:38.415834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:38.418584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:38.420263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a4b8dc4c-6270-4dfc-936a-1520cfef0dd3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.326174 Jun 15 10:51:38.421059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1385/2872] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:38.435804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:38.436418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:38.443392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.444196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.446242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:38.446958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:38.592842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:38.602132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30179b2a-a88b-42a3-8bb6-13e528b0abec tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.241741 Jun 15 10:51:38.603695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1488/2873] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:38.683347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:38.692001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e288701-322a-430a-a0f4-954864a04f53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.267745 Jun 15 10:51:38.692609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1386/2874] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:38 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:39.441133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:39.446252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:39.453129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.457553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.458657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.459328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.620603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:39.621255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:39.628433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.634327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.634327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.634327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.646897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:39.659722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:39.661301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:39.667589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a8e13cab-16e9-42d0-ad7d-6ac4694175f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.229558 Jun 15 10:51:39.679114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1489/2875] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:39.710939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:39.711870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:39.720913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.721518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.722475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:39.722914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:39.832251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:39.842483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f308e4e1-3414-4798-a861-e6921c4b0d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.225780 Jun 15 10:51:39.843166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1387/2876] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:40.114622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:40.130053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-33ac7df0-3298-49a9-92ad-556a031fb89f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.423486 Jun 15 10:51:40.134342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1490/2877] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:40.687730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:40.688811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:40.697188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:40.707614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:40.707614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:40.707614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:40.859879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:40.860567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:40.869909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:40.873931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:40.874909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:40.875429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:40.999264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:41.021699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:41.032324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:41.034743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07347a86-ed14-4d85-b1c1-c557e91ad7a4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.349961 Jun 15 10:51:41.035727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1388/2878] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:41.138488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:41.152290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:41.152509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4cc3c3b7-f877-42ae-b2e4-e34a0b7bb175 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.296084 Jun 15 10:51:41.153340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1491/2879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:41.154297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:41.161157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:41.161761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:41.162628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:41.163289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:41.183331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:41.397460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:41.424449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2bc82e0d-a261-4df5-b37d-c343f2cfabac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.277045 Jun 15 10:51:41.425753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1389/2880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:42.061947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:42.066357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:42.086817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.087508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.090645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.091801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.170053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:42.174999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:42.182358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.183082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.184048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.184653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.445204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:42.465086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:42.466965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:42.468344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ca77354-cf13-4069-b721-553352f7cc29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.418235 Jun 15 10:51:42.480598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1492/2881] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:42.486668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:42.487647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:42.496943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.497745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.498773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:42.499414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:42.547931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:42.557803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b4a5bc98-93c8-41bb-b0ac-4cdd6f304405 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.391492 Jun 15 10:51:42.558397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1390/2882] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:42.775837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:42.792163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5cf66b4-6ec8-46a3-bd9f-2fe97a856227 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.309966 Jun 15 10:51:42.793714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1493/2883] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:43.487270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:43.488141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:43.495310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.495849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.496704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.497238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.575947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:43.576558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:43.591743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.591743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.591743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.591743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.806708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:43.816488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-25731d04-3ace-4d80-97f0-29616fe1ad30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.243902 Jun 15 10:51:43.817210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1494/2884] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:43.823599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:43.824584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:43.831553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.832001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.833948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:43.833948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:43.973805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:43.984555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2665cc72-abc7-4c60-bf08-b57ce2069361 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165298 Jun 15 10:51:43.985164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1495/2885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:43 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:44.137937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:44.151503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:44.153387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:44.154904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e7362401-751e-4f98-926a-44a38365c017 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.671707 Jun 15 10:51:44.155618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1391/2886] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:44.833767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:44.835156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:44.842790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:44.843504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:44.844427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:44.845034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:45.001915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:45.003166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:45.011300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:45.012136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:45.013099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:45.013705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:45.066033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:45.076238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3df48793-97f9-41a6-ab2c-8a11c8aa8585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.246431 Jun 15 10:51:45.077589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1496/2887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:45.175604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:45.177430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:45.192484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:45.192939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:45.210107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:45.211015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:45.255010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:45.264194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e55d46c2-542a-40c8-8ddb-518181166c7c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.266491 Jun 15 10:51:45.266446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1392/2888] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:45.508653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:45.532650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:45.553878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:45.555848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bac3d784-d80d-493d-bcd3-29691e5d8768 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.383925 Jun 15 10:51:45.556471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1497/2889] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:46.095892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:46.095892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:46.102574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.103186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.103964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.104586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.283283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:46.283890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:46.291699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.292450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.293450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.294046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.362083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:46.373558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7444c1ec-2477-4b02-8dc0-5e6f33732694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.282892 Jun 15 10:51:46.385061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1393/2890] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:46.539262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:46.548030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddeed248-6444-4555-8ccb-a35b049aa467 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.268596 Jun 15 10:51:46.548586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1498/2891] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:46.575891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:46.576566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:46.582930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.583456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.585161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:46.585939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:46.732531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:46.743795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:46.745780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:46.747079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6aaa5824-ef12-4f82-af8d-4488d4688803 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.176507 Jun 15 10:51:46.747657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1394/2892] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:47.394864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:47.395544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:47.408035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.427593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.429137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.430344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.570209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:47.579022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:47.596556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.598170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.599445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.600574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.765767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:47.777188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1254e38d-20fe-4975-aa43-b92edce9bea6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.387134 Jun 15 10:51:47.780089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1499/2893] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:47.796111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:47.796934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:47.807874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.808612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.810535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:47.811221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:47.918818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:47.931561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53d79727-a769-47d9-953d-8088253dcdcf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.368282 Jun 15 10:51:47.941914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1395/2894] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:48.067690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:48.078202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:48.080222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:48.082026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1dce69b0-3ea5-4e75-a016-b02958999edf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.300651 Jun 15 10:51:48.093450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1500/2895] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:48.800851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:48.801488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:48.808995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:48.809438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:48.810193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:48.810717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:48.949484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:48.950254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:48.957145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:48.957697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:48.958535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:48.959037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:48.983015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:48.994714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e88eaeb-70b9-40b4-b113-37b15a7ade27 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.197465 Jun 15 10:51:48.995298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1396/2896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:49.098255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:49.103192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:49.103805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:49.107000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a165fe3f-18e7-4684-8a67-1cf17815ed78 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161934 Jun 15 10:51:49.107580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1501/2897] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:49.110936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:49.111403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:49.112177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:49.112489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:49.275796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:49.284549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:49.286091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:49.287261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f6f63af-484a-4af2-9da3-0816be7210ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.188936 Jun 15 10:51:49.287847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1397/2898] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:51:50.013262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:50.013880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:50.022186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.022949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.024489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.024829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.029676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:50.124641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:50.125893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:50.134531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.135290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.136046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.136470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.173827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:50.182595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-11481092-9bc8-4078-86a6-2303587e706d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.174581 Jun 15 10:51:50.183173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1502/2899] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:50.278427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:50.286794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d70ccef-8b01-4ca5-97ff-3deefba9b2f5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.166053 Jun 15 10:51:50.287418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1398/2900] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:50 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:50.306600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:50.307202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:50.313433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.313879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.314633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:50.315075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:50.465719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:50.474825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:50.476346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:50.477669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6621e675-f997-42ac-88e2-0db0291f01ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.175401 Jun 15 10:51:50.478247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1503/2901] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:51.199853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:51.200440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:51.206917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.207464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.208210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.208641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.303474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:51.304166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:51.311343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.311866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.312690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.313231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.338966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:51.347340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d47193e3-0a6f-48d2-a86e-921d61eaefe2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151342 Jun 15 10:51:51.347908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1399/2902] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:51.443965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:51.452149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d17793b8-8929-4b57-a76f-cd7bbe24670f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152430 Jun 15 10:51:51.452648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1504/2903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:51.497531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:51.498155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:51.505486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.505937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.506767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:51.507308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:51.643376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:51.652722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:51.654233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:51.655379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-524fc84d-4f43-4822-9134-43a00e480812 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162309 Jun 15 10:51:51.655932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1400/2904] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:52.365468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:52.366129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:52.373574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.374018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.374780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.375212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.473046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:52.473685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:52.481042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.481488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.482247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.482676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.504678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:52.513344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf9a3bcd-99d1-46be-b0f6-ad8bfe273933 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151654 Jun 15 10:51:52.513918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1505/2905] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:52.622379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:52.630288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ff4ae15-551b-416a-a042-9b5627466898 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161179 Jun 15 10:51:52.630849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1401/2906] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:52.673366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:52.673966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:52.681301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.681749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.682510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:52.682939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:52.814918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:52.823712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:52.825227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:52.826390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e175054-5839-4ecf-87f3-72ebfd7a667b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156945 Jun 15 10:51:52.826948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1506/2907] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:53.531685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:53.532348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:53.534719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:53.540253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.540700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.541497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.541929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.647587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:53.652896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:53.655452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.655904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.656678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.657148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.676974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:53.685989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34aee148-d7a1-4e9e-86d5-36f4e12da171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158187 Jun 15 10:51:53.686562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1402/2908] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:53.789960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:53.798104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1de53213-8cb4-41e4-995b-5387b71548a3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154443 Jun 15 10:51:53.801925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1507/2909] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:53.846136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:53.846855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:53.854714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.859317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.859317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:53.859317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:53.988327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:53.997625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:53.999081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:54.000229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4003df0d-4593-48c6-aa5d-d7dc5420f5f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158397 Jun 15 10:51:54.000784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1403/2910] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:54.703895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:54.704500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:54.712230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:54.712680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:54.713472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:54.713902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:54.815584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:54.816193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:54.823198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:54.823645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:54.825687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:54.825687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:54.853740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:54.862698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22311d69-c119-4314-b385-5ffc4653d268 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162629 Jun 15 10:51:54.863444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1508/2911] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:54.962673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:54.970824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8721130-956a-4641-a2fc-aa0ad1f2c951 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159081 Jun 15 10:51:54.971452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1404/2912] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:55.018869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:55.019974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:55.025716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.029217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:55.029217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.029217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:55.157334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:55.166182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:55.168790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:55.168790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-763139d2-4891-408f-95c9-ceb305d31bc3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.153889 Jun 15 10:51:55.169389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1509/2913] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:55.880782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:55.881464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:55.888350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.888797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:55.889598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.890032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:55.987422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:55.988005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:55.994881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.995326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:55.996093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:55.996525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:56.026290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:56.033350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7478bdc4-b811-42b2-8f9b-1ea0da7be38e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156416 Jun 15 10:51:56.033923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1405/2914] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:56.130136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:56.138887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1befc149-4b26-4749-af60-0a8bc2d72579 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155131 Jun 15 10:51:56.139375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1510/2915] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:56.186420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:56.187164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:56.194434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:56.194883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:56.196178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:56.196812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:56.200939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:56.326995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:56.335552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:56.337714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:56.338868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4ddfa125-9ad8-4aaa-b173-cceb6887d5b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156372 Jun 15 10:51:56.339443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1406/2916] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:57.050908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:57.051499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:57.053803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:51:57.059419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.059866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.060626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.061086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.155825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:57.156536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:57.163128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.163651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.164414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.165405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.193511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:57.202170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-403a986d-a1c5-49db-91e4-ffbb72e6d119 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155026 Jun 15 10:51:57.202743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1511/2917] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:57.299184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:57.307702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f10b7ce-15ad-4f1d-92ba-e65c2efa66fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155766 Jun 15 10:51:57.308202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1407/2918] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:57 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:57.358405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:57.359038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:57.364996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.365439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.366182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:57.366629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:57.496401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:57.504841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:57.506352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:57.507505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-75570e0a-0545-4d7b-8943-b25aca2bf364 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.152943 Jun 15 10:51:57.508055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1512/2919] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:51:58.223060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:58.223939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:58.231217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.231667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.232441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.232904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.325446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:58.326055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:58.332810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.333281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.334041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.334482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.365325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:58.374363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bfad5747-42cf-4ef4-b87f-dfd5f62d13ef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158674 Jun 15 10:51:58.375083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1408/2920] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:58.470463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:58.479627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5cb7871-cf7d-40d3-9319-9406994b7697 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158858 Jun 15 10:51:58.480198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1513/2921] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:58.526327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:58.526933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:58.538322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.538780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.539602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:58.541194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:58.671656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:58.681363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:58.682886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:58.684056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69a3dc9b-dc43-4f88-915f-2769ca2603f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162212 Jun 15 10:51:58.684611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1409/2922] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:51:59.391454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:59.392057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:59.398626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.399064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.400986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.401417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.497663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:59.498283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:59.504625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.505048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.505815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.506249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.532483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:59.541541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c98edda-198f-4490-9cd0-8449dfe7787a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153904 Jun 15 10:51:59.546967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1514/2923] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:51:59.641711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:59.649926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5e39d9d-f9ed-46e1-bc34-281c25ea3a97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156922 Jun 15 10:51:59.650519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1410/2924] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:51:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:51:59.703231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:51:59.703826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:51:59.709811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.710252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.710991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:51:59.711500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:51:59.843447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:59.852889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:59.854529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:51:59.855680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f17852b7-c12c-4ec4-983e-0147bacf7764 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156653 Jun 15 10:51:59.856230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1515/2925] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:51:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:00.559003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:00.559620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:00.566289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.566739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:00.567504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.567941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:00.667622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:00.668175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:00.674638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.675087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:00.675859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.676297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:00.697102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:00.705241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf081c22-326c-4c32-9e4a-9084c084c9eb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150538 Jun 15 10:52:00.705814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1411/2926] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:00.805065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:00.813984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-637af1b2-988f-4998-89f4-c41e27c47669 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150909 Jun 15 10:52:00.814557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1516/2927] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:00.874490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:00.875092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:00.881256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.881703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:00.882457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:00.882888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:01.013885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:01.022197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:01.023664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:01.025321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0e1f34e-88ff-4d0e-ade7-43b7bbb89faf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154241 Jun 15 10:52:01.025907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1412/2928] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:01.723022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:01.723684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:01.730150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:01.730592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:01.731348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:01.731783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:01.831915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:01.832626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:01.840761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:01.841398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:01.842577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:01.843271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:01.862939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:01.872374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd7603f9-37cb-46ad-b192-7ac8069ab66a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153092 Jun 15 10:52:01.872952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1517/2929] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:01.974488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:01.982676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e3a5251e-88f1-461f-ae42-fd3952b77def tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154696 Jun 15 10:52:01.983283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1413/2930] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:02.043510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:02.044112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:02.050207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:02.050651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:02.051435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:02.051862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:02.186931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:02.190384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:02.195787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:02.197351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:02.198525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f996e472-e8b2-41cf-b5fc-a1f76fc75038 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158911 Jun 15 10:52:02.202647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1518/2931] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:02.893664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:02.894240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:02.901550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:02.901999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:02.902761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:02.903193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:03.000111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:03.000728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:03.007762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:03.008205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:03.009546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:03.009990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:03.031278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:03.039359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6490231-cad5-45fc-b134-426142073e83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149691 Jun 15 10:52:03.039932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1414/2932] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:03.138726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:03.146927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a048d766-0050-48c4-a0df-493e1cc294d7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150491 Jun 15 10:52:03.147423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1519/2933] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:03.219708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:03.220368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:03.226653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:03.227086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:03.227870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:03.228388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:03.359765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:03.369069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:03.370779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:03.371965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7f9ad324-5cab-4a36-bec9-a7d5a2fd750f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156141 Jun 15 10:52:03.372551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1415/2934] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:04.057335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:04.057948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:04.064363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.064801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.065582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.066011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.164770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:04.165576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:04.172885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.173444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.174309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.174819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.199572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:04.207851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-655458fc-9bc8-412f-9e09-6c4896ed373a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155035 Jun 15 10:52:04.208524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1520/2935] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:04.306616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:04.314667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-153aeebe-cccb-4e65-bb65-3e4315c56379 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153768 Jun 15 10:52:04.315161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1416/2936] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:04 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:04.390848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:04.391453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:04.397482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.397921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.398683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:04.399094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:04.530512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:04.539182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:04.541433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:04.543119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c9d6ded-3a30-4094-a221-fcd073e6f7a2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.155817 Jun 15 10:52:04.543321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1521/2937] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:05.226482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:05.227092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:05.234305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.234742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.235491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.235921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.331370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:05.331973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:05.338960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.339408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.340432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.340861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.372042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:05.380387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0604f1ea-1bc4-412f-8938-de9732bfc7b1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157876 Jun 15 10:52:05.381202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1417/2938] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:05.476866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:05.485726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4350a815-067b-4191-abe8-429522b6fef2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158056 Jun 15 10:52:05.486289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1522/2939] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:05.560595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:05.561232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:05.567234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.567670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.568429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:05.568855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:05.696565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:05.705254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:05.706735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:05.707884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d577983a-eae8-43ec-9f6a-39cd84b38879 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.151421 Jun 15 10:52:05.708437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1418/2940] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:06.397993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:06.398605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:06.405759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.406205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.406957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.407390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.502047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:06.502796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:06.509342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.509820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.510640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.511071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.537789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:06.547239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f8652845-5f14-4f28-b43c-12674264cbaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153367 Jun 15 10:52:06.547812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1523/2941] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:06.644058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:06.652988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc3400b7-edb2-4de5-9096-ef0184067623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154627 Jun 15 10:52:06.653515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1419/2942] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:06.727166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:06.727803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:06.733906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.734351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.735117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:06.735550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:06.864276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:06.873729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:06.875215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:06.876388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50cd2395-f776-4029-9488-7f73bedd8ea9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.153142 Jun 15 10:52:06.876948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1524/2943] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:07.564482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:07.565113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:07.571665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.572132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:07.573063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.573502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:07.670764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:07.671388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:07.678055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.678504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:07.679274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.679707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:07.712432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:07.721948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c1103eda-b319-4c25-86b3-860606a62e82 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161183 Jun 15 10:52:07.722524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1420/2944] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:07.812368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:07.820469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1acd5182-7e69-4956-bd9d-76a15693c6cb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153436 Jun 15 10:52:07.821060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1525/2945] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:07.895419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:07.896058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:07.903171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.903629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:07.904395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:07.904833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:08.032519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:08.040847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:08.043573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:08.044723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-afb3a548-69e3-43b8-b3a7-184c9ae9a0b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.153212 Jun 15 10:52:08.045303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1421/2946] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:08.740411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:08.741158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:08.748708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:08.749187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:08.749941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:08.750370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:08.838081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:08.838754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:08.845609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:08.846058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:08.846822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:08.847255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:08.881492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:08.889620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-42e7b78b-7174-4cd5-a679-17b67d8dafc3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152970 Jun 15 10:52:08.890200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1526/2947] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:08.980344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:08.983791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:08.988643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4f4fd3a8-15e0-46ea-b639-72442ec1bed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154469 Jun 15 10:52:08.989233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1422/2948] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:09.062828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:09.063444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:09.069607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:09.070026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:09.070773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:09.071195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:09.202889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:09.211322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:09.213565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:09.214899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-974a9071-3644-4cff-826e-b68ba1e7776e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.155819 Jun 15 10:52:09.215444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1527/2949] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:09.908345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:09.908917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:09.915603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:09.916049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:09.916906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:09.917367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:10.006525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:10.007121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:10.014691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:10.015131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:10.015893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:10.016322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:10.049348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:10.058304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4399eea4-8df0-4ef1-a24c-6ac37e8d2a75 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154124 Jun 15 10:52:10.058919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1423/2950] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:10.151290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:10.159358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aa99b89d-a8f2-4583-974a-523e388f5936 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156705 Jun 15 10:52:10.159851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1528/2951] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:10 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:10.233254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:10.233859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:10.240414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:10.240849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:10.241634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:10.242062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:10.378575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:10.387150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:10.388619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:10.389798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-021094c4-f042-49ab-8f9d-2ac60e76189d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160669 Jun 15 10:52:10.390349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1424/2952] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:11.076441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:11.077025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:11.083847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.084295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.085093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.085526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.175909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:11.176522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:11.185437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.185881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.186648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.187077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.231063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:11.239298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bf33b9d8-4fd3-4c79-9b8b-139289edebeb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.167397 Jun 15 10:52:11.239889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1529/2953] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:11.407689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:11.408190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:11.410939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:11.414329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.414769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.415529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:11.416531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:11.420683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4e18f72-504b-47bf-98fd-84b667d0c4a7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.248722 Jun 15 10:52:11.421340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1425/2954] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:11 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:11.551427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:11.560506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:11.562053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:11.563198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc5aa4e4-b7e5-42a8-aeee-09f573443c01 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159507 Jun 15 10:52:11.563751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1530/2955] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:12.258152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:12.258772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:12.266642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.267085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.267839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.268264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.400779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:12.408847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e905d328-0d3d-4436-bc03-5b6d4c51706b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154513 Jun 15 10:52:12.409436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1426/2956] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:12.438326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:12.439017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:12.445989 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.446434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.448111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.448578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.579848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:12.581748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:12.582434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:12.588275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cab5834b-c638-4d6c-a95e-d1edfd1985e8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153706 Jun 15 10:52:12.588577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.588734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.592607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1531/2957] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:12 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:12.592780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:12.592780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:12.723484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:12.732769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:12.734272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:12.735434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9fb255ad-2cd2-4b67-8957-225550386810 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.157517 Jun 15 10:52:12.735987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1427/2958] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:13.426388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:13.427048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:13.433216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.433676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.434421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.434856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.606398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:13.607022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:13.614175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.614622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.615405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.615943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.757539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:13.766370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-91aa214b-d251-41e7-b46e-08d9d088873e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164205 Jun 15 10:52:13.767229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1428/2959] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:13.771619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:13.772231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:13.780302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.781257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.781545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:13.781977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:13.802695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:13.812807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e17af970-d23e-46d7-9041-ce3fd46c13d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.390020 Jun 15 10:52:13.813859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1532/2960] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:13.921592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:13.928976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:13.930456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:13.931780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-234e9e8b-9411-4016-9913-052dac1a2cce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.163728 Jun 15 10:52:13.932573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1429/2961] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:14.783723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:14.784332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:14.791139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.791806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.792377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.792758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.830054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:14.830723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:14.837438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.838001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.838793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.839233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.924718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:14.933689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ff7bafb4-cf91-4d7c-89cb-7ccd7fb34940 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153768 Jun 15 10:52:14.934272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1533/2962] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:14.950140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:14.950881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:14.956838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.957317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.958085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:14.958520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:14.975250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:14.984697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bd56a9b0-c9ad-4bc2-85c8-b09ea53714c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158413 Jun 15 10:52:14.985287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1430/2963] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:15.096103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:15.107035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:15.108562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:15.109761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4cc0cf58-1672-443d-b716-9fc233b8a9f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.163480 Jun 15 10:52:15.110308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1534/2964] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:15.950632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:15.951243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:15.958546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:15.958990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:15.959742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:15.960171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:16.003292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:16.003937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:16.011329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:16.011777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:16.012552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:16.013004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:16.031605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:16.090116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:16.098427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-518a7c1c-9553-4aed-926f-daf6f4eb45bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151601 Jun 15 10:52:16.099001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1431/2965] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:16.127671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:16.128314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:16.134524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:16.135453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:16.136224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:16.136660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:16.143213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:16.151647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd816d23-2fa5-451f-9cb2-701f71c2566a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152189 Jun 15 10:52:16.152221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1535/2966] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:16.266756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:16.275311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:16.276789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:16.278057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c31a892-905a-46f5-afb0-a71efb4f9399 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154316 Jun 15 10:52:16.278614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1432/2967] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:17.115495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:17.116215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:17.124280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.124725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.125516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.125946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.170367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:17.171065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:17.178227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.178939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.179749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.180658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.267311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:17.275499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e0a76c59-5f66-452f-a522-2bf758e307eb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163810 Jun 15 10:52:17.276140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1536/2968] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:17 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:17.296105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:17.296736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:17.303582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.304032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.304794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:17.305260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:17.321632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:17.329769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e3ac909-992f-4364-8516-68644f0d5f41 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165302 Jun 15 10:52:17.330346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1433/2969] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:17.435784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:17.444344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:17.445957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:17.447849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74c42428-cbc3-4c07-9faf-6ea0b1528203 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154877 Jun 15 10:52:17.448433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1537/2970] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:18.292360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:18.292991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:18.299639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.300080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.300870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.301330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.347836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:18.348585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:18.355833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.356273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.357057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.357494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.434879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:18.444158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2aea2489-bba7-40be-b3b3-cfc1b2a60963 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155649 Jun 15 10:52:18.445257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1434/2971] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:18.466873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:18.467488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:18.473699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.474151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.474929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:18.475447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:18.491908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:18.500140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-038bae8d-a060-46d2-944f-6b1545027837 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156161 Jun 15 10:52:18.500718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1538/2972] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:18.615850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:18.624487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:18.625987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:18.627137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-948ceb45-1635-4de5-9503-1fbdd272f81c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.165143 Jun 15 10:52:18.627695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1435/2973] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:19.461153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:19.461793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:19.469297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.469768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.470530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.470968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.517446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:19.518006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:19.524578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.525786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.526944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.527385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.605752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:19.613856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-64939eb4-acac-4657-b891-0db3347478aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156667 Jun 15 10:52:19.614427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1539/2974] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:19.645854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:19.646432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:19.653786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.654228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.654984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:19.655414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:19.659957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:19.668742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3ebc76a8-255f-4b3b-862f-40ba6d31d9a1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155309 Jun 15 10:52:19.669432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1436/2975] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:19.793156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:19.794043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:19.795553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:19.796710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae20bc38-e984-4628-9f90-e080c704577e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154854 Jun 15 10:52:19.797306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1540/2976] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:20.630966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:20.631577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:20.638851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.639295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.640055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.640496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.687823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:20.688464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:20.695087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.695605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.696390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.697402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.775370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:20.783657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3079d24a-c23b-4586-ab87-a46484f57895 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156459 Jun 15 10:52:20.784325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1437/2977] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:20.816138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:20.816652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:20.823557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.824167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.825053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:20.825557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:20.836144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:20.844817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b8ef98bd-1300-480f-8486-910a8e606318 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162069 Jun 15 10:52:20.845538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1541/2978] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:20.960866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:20.969793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:20.971336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:20.972483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40eca8b2-1acd-40d2-855f-a41b3766132a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160346 Jun 15 10:52:20.973054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1438/2979] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:21.801624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:21.802227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:21.808974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:21.809447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:21.810396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:21.810830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:21.863238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:21.863873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:21.870697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:21.871140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:21.872436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:21.873270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:21.892713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:21.943567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:21.952255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-847e0d70-a3b0-4ea3-a7fd-8f516c466e59 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154428 Jun 15 10:52:21.952837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1542/2980] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:21.991361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:21.991991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:21.998636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:21.999076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:21.999846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:22.000278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:22.006331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:22.014993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-86236dd7-3faf-4665-af23-8daa942da531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155668 Jun 15 10:52:22.015777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1439/2981] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:22.127915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:22.136583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:22.138709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:22.139878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b870043d-ed4c-4864-a711-d81f40738558 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.152680 Jun 15 10:52:22.140435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1543/2982] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:22.971055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:22.971660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:22.978230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:22.978674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:22.979430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:22.979866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:23.033526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:23.034131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:23.040295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:23.040750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:23.041549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:23.042159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:23.114955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:23.123055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fa6c4ad-812f-449d-b7a7-18b78e07b91e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155794 Jun 15 10:52:23.123631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1440/2983] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:23.158289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:23.172437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:23.172437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:23.172437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:23.172437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:23.172894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:23.178853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:23.187741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-516ab12a-bbbb-47d3-ba7d-517689c5e61f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159614 Jun 15 10:52:23.188443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1544/2984] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:23.300045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:23.308679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:23.310301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:23.311562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3c153cf4-7431-4899-97c3-3778882943aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.157198 Jun 15 10:52:23.312107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1441/2985] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:24.140475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:24.141123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:24.147662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.148113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.148865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.149321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.204461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:24.205197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:24.207610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=80 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:24.212430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.212945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.213746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.214174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.284455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:24.293515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8546c0ed-c302-4bd7-8237-bebe5da7b4bb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156614 Jun 15 10:52:24.294135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1545/2986] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:24.330719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:24.331518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:24.338339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.338794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.339819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:24.340258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:24.371858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:24.380903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d11bce4e-02d3-44a3-89da-4ebb9748aafe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.180204 Jun 15 10:52:24.381726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1442/2987] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:24.488152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:24.493698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:24.495170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:24.496343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-955ac2c0-00fe-406e-8b11-41737de78e24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.169761 Jun 15 10:52:24.496869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1546/2988] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:25.312608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:25.313193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:25.319300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.319739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.320492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.320943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.398395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:25.401185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:25.407141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.407594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.408412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.408810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.461574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:25.471900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae071bfa-9cf2-451e-9ae4-fb8beb94e99e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163395 Jun 15 10:52:25.472735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1443/2989] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:25 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:25.515624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:25.515624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:25.522173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.523063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.523839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:25.524281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:25.544195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:25.556768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5bf7f42e-cfb7-4f23-abd4-2accbbdcc7cb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162237 Jun 15 10:52:25.557487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1547/2990] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:25.660782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:25.669339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:25.670829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:25.672210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa904691-ad98-4046-9da8-6466287fe3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160987 Jun 15 10:52:25.672775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1444/2991] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:26.489192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:26.489796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:26.496580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.497043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.497791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.498212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.575493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:26.576082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:26.584944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.585421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.586188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.586630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.636807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:26.645903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-44b7c9c4-ffea-4436-b3e1-2679be567813 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160533 Jun 15 10:52:26.646479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1548/2992] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:26.691053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:26.691791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:26.697963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.698401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.699164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:26.699639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:26.723482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:26.732637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03bab9ca-b80f-4662-ad5e-fb468b960b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160887 Jun 15 10:52:26.733240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1445/2993] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:26.833879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:26.842609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:26.844477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:26.845691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ce7dc6e-e57b-4b2a-967d-8c5be3c7db0f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159127 Jun 15 10:52:26.846250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1549/2994] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:27.663834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:27.664375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:27.670915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.671358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.672249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.672685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.751374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:27.751990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:27.754575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=78 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:27.759469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.759917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.760684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.761146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.806698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:27.815484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92a139ed-6deb-4d65-a3a1-68ea0bd1a717 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155520 Jun 15 10:52:27.816050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1446/2995] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:27.863633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:27.864234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:27.870436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.870884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.871661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:27.872118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:27.898980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:27.907481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-95cf32ed-cacd-48bd-88cf-816fa9b2bdce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159949 Jun 15 10:52:27.908049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1550/2996] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:28.006978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:28.016281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:28.017878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:28.019032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36f0e1a5-f81f-4486-9ddc-37d00bddc62b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159349 Jun 15 10:52:28.019588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1447/2997] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:28.832922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:28.833580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:28.840417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:28.840865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:28.841649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:28.842117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:28.925299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:28.925900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:28.935087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:28.936348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:28.937229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:28.937676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:28.979082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:28.988176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-547131db-5f23-438f-a546-d848adca975e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159314 Jun 15 10:52:28.988754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1551/2998] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:29.038060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:29.038810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:29.044916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:29.045484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:29.046250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:29.046929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:29.051163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:29.071220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:29.080615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2278f6c9-61e9-4086-a551-b299985abc12 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159248 Jun 15 10:52:29.081275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1448/2999] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:29.179009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:29.187978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:29.189500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:29.190663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ea3ba5a-7f2c-44e6-9dcb-7bb1c3330961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156511 Jun 15 10:52:29.191212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1552/3000] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:30.005822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:30.006540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:30.013559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.014017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.014790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.015809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.100914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:30.101582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:30.108816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.109391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.110234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.110616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.152522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:30.160779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-258fc225-9f95-4b59-ad0b-cf160dd88f71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158868 Jun 15 10:52:30.161716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1449/3001] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:30 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:30.209090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:30.209883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:30.216315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.216757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.217566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:30.218028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:30.252832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:30.261322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcb204dd-a33d-43ec-863b-5da9f30c99bf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164800 Jun 15 10:52:30.261827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1553/3002] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:30.352541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:30.361879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:30.363360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:30.364510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8fb1e74e-3b8f-41df-b5b1-fab52e2a8ecb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159311 Jun 15 10:52:30.365290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1450/3003] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:31.177773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:31.178367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:31.185199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.185644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.186407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.186846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.279248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:31.279857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:31.286541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.286989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.287756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.288192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.324585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:31.332813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a360179-78d7-48a5-8aaf-b12e286174a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158998 Jun 15 10:52:31.333663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1554/3004] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:31 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:31.382452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:31.383057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:31.389097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.389539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.390348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:31.391414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:31.421009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:31.431096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e82ccb68-3abc-4d1f-bac0-bb27dbde172c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155496 Jun 15 10:52:31.431592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1451/3005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:31.523227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:31.532675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:31.534201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:31.535369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d626bb3e-dc0a-4159-b770-4a0ef2c712df tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156764 Jun 15 10:52:31.535929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1555/3006] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:32.350505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:32.351102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:32.357628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.358069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.358813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.359245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.448986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:32.449597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:32.456899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.457363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.458121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.458551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.497117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:32.505674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07242ec9-5ba2-4a0d-a22e-4a2125960b29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158912 Jun 15 10:52:32.506250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1452/3007] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:32 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:32.554214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:32.555023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:32.561196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.561651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.562417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:32.562850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:32.602733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:32.608179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3418630-50f5-4475-b149-0a884b737ede tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163081 Jun 15 10:52:32.609086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1556/3008] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:32.693488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:32.702353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:32.704417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:32.705606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0dc3aa77-7eae-45b4-84df-ded89311e2ad tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.155487 Jun 15 10:52:32.706165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1453/3009] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:33.524103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:33.524718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:33.531914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.532361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.534683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.534683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.627469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:33.628056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:33.634473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.634974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.635749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.636192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.669742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:33.679146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23f28d84-0b1f-47ae-a48c-8354f811f909 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159251 Jun 15 10:52:33.689084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1557/3010] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:33.725345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:33.726758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:33.737328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.740686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.740686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:33.740686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:33.777479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:33.786181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65041a30-6432-4e14-9f5f-d3455f7e0fb5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163636 Jun 15 10:52:33.786748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1454/3011] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:33.884598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:33.893465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:33.894954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:33.896101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6bb1bba6-0878-4241-a014-901e4af9c3e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.175859 Jun 15 10:52:33.896657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1558/3012] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:34.697274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:34.697884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:34.705330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.705777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.706529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.706955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.804092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:34.804777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:34.811294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.811810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.812655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.813410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.837009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:34.845847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-77f22786-71f5-444c-9c75-1c81cd98290b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152351 Jun 15 10:52:34.846416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1455/3013] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:34.914743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:34.915354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:34.921351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.921799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.922727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:34.923166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:34.927404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:34.947263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:34.956392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c44a3361-1ff3-4689-888e-655c85a25bb0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156166 Jun 15 10:52:34.956984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1559/3014] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:35.055148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:35.060445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:35.061959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:35.063474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c259c24-eed2-49e8-bd9b-3f30a7a924d6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.152241 Jun 15 10:52:35.065260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1456/3015] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:35.862931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:35.863529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:35.870171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:35.870606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:35.871371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:35.871798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:35.973899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:35.974628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:35.981542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:35.981991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:35.982792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:35.983234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:36.006248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:36.014211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc97e2f5-03a4-4655-b214-b785479a74e3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155226 Jun 15 10:52:36.014781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1560/3016] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:36.082422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:36.083036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:36.089061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:36.089509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:36.090525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:36.090957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:36.118881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:36.127875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b7e8b99-a90d-4c76-842d-f6e4176dfff0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157817 Jun 15 10:52:36.128447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1457/3017] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:36.220541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:36.229574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:36.231040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:36.232185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd27a6d8-b1fb-4ca1-9145-0dca6577d33c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154402 Jun 15 10:52:36.232739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1561/3018] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:37.031547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:37.032161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:37.039729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.040206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.040993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.041426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.176845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:37.184802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-610ccb46-54ed-4c17-948d-be74547e3d8a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157061 Jun 15 10:52:37.185411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1458/3019] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:37 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:37.250599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:37.251211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:37.257199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.257651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.258443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.258906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.397671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:37.405095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:37.406133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:37.406312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:37.408343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:37.409564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-01694c1a-297a-42a3-bfab-8e25912ecd5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162809 Jun 15 10:52:37.410289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1459/3020] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:37.413850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.414292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.415046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:37.415477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:37.548026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:37.556861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dedf3f98-0577-43be-a5e4-db50de20e708 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.415101 Jun 15 10:52:37.557460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1562/3021] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:38.201939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:38.202525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:38.209764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.210204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.210951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.211377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.351911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:38.360037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-883389fe-fd90-4174-995d-e6c4b1ea8d9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161862 Jun 15 10:52:38.361315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1460/3022] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:38 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:38.428513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:38.429176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:38.435791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.436261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.437046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.437473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.575416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:38.576031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:38.579643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:38.583593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.584396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.585230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:38.585668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:38.589500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:38.591327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:38.592506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-479eace9-93cc-4839-958b-b3e9381a8ca6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.168046 Jun 15 10:52:38.604024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1563/3023] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:38.721407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:38.729664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2143898f-2058-446c-be41-12828ee6982a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158156 Jun 15 10:52:38.730242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1461/3024] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:39.380726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:39.381804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:39.388431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.388878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.389679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.390109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.518215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:39.526501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-77450c15-74f1-412c-b0dc-d9a152d1c494 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151965 Jun 15 10:52:39.527074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1564/3025] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:39.611985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:39.612750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:39.619466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.619914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.620683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.621166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.747750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:39.748394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:39.755677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.755877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:39.756123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.756894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:39.757355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:39.765173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:39.767499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:39.768785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a2048e87-86a6-4de5-8e42-b55f3645514c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160751 Jun 15 10:52:39.769372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1462/3026] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:39.893063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:39.901518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a1ea0b64-cf4e-4e48-966d-147ef79466db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157642 Jun 15 10:52:39.902089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1565/3027] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:40.544240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:40.544937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:40.553718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.554173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.554958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.555399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.686777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:40.695900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d0780e34-69bc-47c2-a741-05cdde40048a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155703 Jun 15 10:52:40.696453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1463/3028] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:40.787763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:40.788346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:40.794970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.795350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.796094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.796523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.919694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:40.920396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:40.930748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.931293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.932088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:40.932524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:40.940423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:40.949574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:40.951185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:40.952445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d0d74f5b-57ef-403d-ae1f-3255d4054f33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.168578 Jun 15 10:52:40.953103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1566/3029] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:41.074269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:41.082554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-435cc1f9-e29d-4c9c-98ae-7283c63a3856 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.166743 Jun 15 10:52:41.083122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1464/3030] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:41.714019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:41.714885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:41.722179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:41.722622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:41.723371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:41.723818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:41.854649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:41.862970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f04259a-8761-4043-8e27-31b6616c0e26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152829 Jun 15 10:52:41.863539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1567/3031] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:41.971663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:41.972191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:41.978787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:41.979228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:41.979979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:41.980409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:42.100210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:42.100825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:42.106794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:42.107236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:42.107990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:42.108422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:42.112602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:42.121112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:42.122595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:42.123760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29fb41bc-ee56-4e8f-b1b1-5f07ca768890 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156630 Jun 15 10:52:42.124324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1465/3032] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:42.249150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:42.253242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:42.258300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8537451-4b1d-4446-80f3-301d4a5a0622 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161933 Jun 15 10:52:42.258877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1568/3033] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:42.880168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:42.880689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:42.886973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:42.887413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:42.888167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:42.888596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:43.022802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:43.030925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed5d2668-3c83-4c48-af05-931755a252d6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154666 Jun 15 10:52:43.031486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1466/3034] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:43.144058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:43.144618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:43.151387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:43.151830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:43.152591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:43.153047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:43.275725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:43.276313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:43.282340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:43.283774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:43.284903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:43.285414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:43.287644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:43.296299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:43.297831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:43.299035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7347b8ed-1154-4f5c-9974-7786620177a7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160071 Jun 15 10:52:43.299601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1569/3035] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:43.442237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:43.450815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d94065f-d353-492c-ae25-b5a5f756533f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.179081 Jun 15 10:52:43.451393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1467/3036] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:44.049569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:44.050182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:44.056524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.056981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.057760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.058188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.199908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:44.209432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50493acd-7c5c-4cc2-b883-07a0afebdf1c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164404 Jun 15 10:52:44.209997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1570/3037] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:44.319017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:44.319893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:44.327467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.328002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.328787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.329847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.471745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:44.472648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:44.480379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.480907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.481781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:44.482223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:44.483629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:44.500945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:44.504165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:44.506396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-31b31ef3-5956-4af2-8c4c-ee5a32b261b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.191321 Jun 15 10:52:44.507445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1468/3038] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:44.628193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:44.636545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93cb8cdd-11ea-4134-8855-8099ba65b160 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.169996 Jun 15 10:52:44.637227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1571/3039] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:45.227199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:45.227830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:45.234313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.234758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.235698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.236698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.376532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:45.389422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d59e3269-1967-44b1-81f4-7d0002201832 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165940 Jun 15 10:52:45.390011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1469/3040] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:45 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:45.533199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:45.533867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:45.540653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.541126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.541889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.542672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.657984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:45.659295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:45.667342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.667785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.668557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:45.669016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:45.689107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:45.699915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:45.701818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:45.703032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-350d5037-713d-44a6-8544-1a089aec246c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.177281 Jun 15 10:52:45.703593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1572/3041] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:45.807862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:45.816546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1bd3d6f-9e85-4230-9f50-3637e3e0231c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165367 Jun 15 10:52:45.817156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1470/3042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:46.408058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:46.408674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:46.415249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.415700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.416473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.416911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.553090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:46.561265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-721f17b7-e5a5-40d2-bdb1-bee759dd3d71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157422 Jun 15 10:52:46.561841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1573/3043] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:46.722545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:46.723213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:46.730262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.730700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.731474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.731901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.834531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:46.835275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:46.842144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.842672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.843543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:46.844152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:46.877857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:46.887608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:46.889290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:46.890395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d6adf40-2a28-4bf2-a081-f133f03b26ae tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.172637 Jun 15 10:52:46.890967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1471/3044] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:46.982689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:46.991509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3faf73d-6d5e-4400-b002-12f652921d36 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160986 Jun 15 10:52:46.992066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1574/3045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:47.578695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:47.580162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:47.586763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:47.587203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:47.587974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:47.588407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:47.728806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:47.733109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:47.739877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-200f3d9f-0957-415c-a2ce-0c052294182e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165078 Jun 15 10:52:47.740492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1472/3046] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:47.911859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:47.912410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:47.919417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:47.919869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:47.920653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:47.921181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:48.009091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:48.009705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:48.016029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:48.016477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:48.017973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:48.018406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:48.061778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:48.071035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:48.072535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:48.073764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7fca7a69-e8d2-465a-8db0-2d91bc0e6daf tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166776 Jun 15 10:52:48.074328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1575/3047] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:48.151591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:48.160339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b1346f5b-77da-43a7-bb2f-80d1e47b665f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155219 Jun 15 10:52:48.161144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1473/3048] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:48.757795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:48.758420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:48.765253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:48.765710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:48.767344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:48.767577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:48.913488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:48.922192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3f6e2b3-128c-4e5f-8576-74589c6932ea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.168309 Jun 15 10:52:48.922804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1576/3049] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:49.092971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:49.093584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:49.100427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.100806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:49.101601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.102035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:49.178709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:49.179319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:49.185389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.186242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:49.186607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.187034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:49.245088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:49.254718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:49.256204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:49.257511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c4fb5779-0138-4763-9e73-d64c4c0eea65 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.168684 Jun 15 10:52:49.258141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1474/3050] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:49.331232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:49.339825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1582d65-d817-4b10-b8bb-6b1b3f055158 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164702 Jun 15 10:52:49.340395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1577/3051] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:49.940151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:49.940758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:49.946940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.947381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:49.948180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:49.948608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:50.086104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:50.095499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c30cd550-bc31-4f10-91ae-82e60729bfe8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159394 Jun 15 10:52:50.105783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1475/3052] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:49 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:50.277212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:50.277820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:50.285412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:50.285859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:50.287165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:50.287165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:50.357638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:50.358342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:50.366276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:50.366276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:50.367216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:50.367872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:50.420473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:50.430483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:50.431973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:50.433204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d8d47e3e-462d-4a16-a5c7-7449333219ee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159966 Jun 15 10:52:50.434931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1578/3053] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:50.509584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:50.517888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c5021df4-6f45-4cb8-baed-a4427ddd5635 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164193 Jun 15 10:52:50.518455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1476/3054] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:51.114542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:51.115154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:51.121376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.121824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.122594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.123028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.257508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:51.265992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22e96e4b-4a19-4e87-9e4a-8cb8091fdcca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156126 Jun 15 10:52:51.267254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1579/3055] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:51.451910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:51.452545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:51.459544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.459992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.460759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.461217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.535731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:51.536557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:51.544326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.544509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.545346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:51.545593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:51.599242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:51.607951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:51.609449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:51.611262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba95dcfb-d843-449c-a038-0101e083b57c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.163215 Jun 15 10:52:51.611838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1477/3056] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:51.685964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:51.695115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62e1b7d8-a48e-4054-87d6-24bdb9d33d5f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163527 Jun 15 10:52:51.695690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1580/3057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:52.284675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:52.285305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:52.291414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.291857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.292642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.293106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.434747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:52.443103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc57bc13-7b1b-47c5-a997-1deb95925d88 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.162990 Jun 15 10:52:52.443677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1478/3058] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:52.630479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:52.631061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:52.637755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.638188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.638967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.639398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.716453 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:52.717260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:52.725769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.726099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.726806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:52.727347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:52.772819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:52.781467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:52.783088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:52.784251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee364e28-c5f8-43d4-98a5-b3a0a0ff7e1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158473 Jun 15 10:52:52.784802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1581/3059] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:52.861673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:52.869876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e614a72-2a10-40e7-ade4-382857e726e1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161446 Jun 15 10:52:52.870462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1479/3060] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:53.459975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:53.460620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:53.468865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.469348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.470923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.471371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.610975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:53.619297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2948d273-b13f-404e-a381-b3f854c106d1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163331 Jun 15 10:52:53.619872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1582/3061] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:53.802365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:53.802954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:53.809663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.810113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.810872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.811307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.887664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:53.888277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:53.895611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.896065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.896905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:53.897312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:53.943705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:53.952434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:53.954488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:53.955660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a1dd850-e3a9-4e92-85fd-bd0e76b4c87f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.157253 Jun 15 10:52:53.956222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1480/3062] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:54.031548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:54.042511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c6977b22-3325-430c-9300-3258f25cad2c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158594 Jun 15 10:52:54.043096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1583/3063] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:54.639705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:54.640651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:54.643161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=78 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:54.648698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:54.649183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:54.649977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:54.650411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:54.792472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:54.801509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6d328e5e-99e1-47aa-95f4-d054b0995623 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.167888 Jun 15 10:52:54.802087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1481/3064] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:54.974147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:54.974745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:54.981464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:54.981910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:54.982680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:54.983121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:55.060111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:55.061411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:55.068813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:55.069983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:55.070762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:55.071200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:55.133406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:55.144351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:55.146049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:55.147625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51efb22b-455f-47cf-8bf5-d0559356cca8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.177742 Jun 15 10:52:55.148314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1584/3065] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:55.372285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:55.381355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f42417a4-03fe-472a-a271-3bc8dcbe73f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.325055 Jun 15 10:52:55.381924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1482/3066] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:55.818694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:55.819299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:55.825596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:55.826038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:55.826799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:55.827226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:55.847000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:55.966017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:55.975039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2419f2f6-92cb-4622-b660-4e31caa64e9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160089 Jun 15 10:52:55.976012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1585/3067] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:56.167552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:56.168116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:56.175997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:56.176498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:56.177385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:56.177813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:56.318001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:56.326766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:56.328221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:56.329393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32d8dc9b-9843-4392-87c5-c65357edde44 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166266 Jun 15 10:52:56.330117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1483/3068] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:56.398767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:56.399370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:56.406100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:56.406547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:56.407794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:56.408224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:56.544332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:56.554111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f7b7202c-9665-491c-a4e9-fa878f8ebdcb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159101 Jun 15 10:52:56.554746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1586/3069] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:56.992196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:56.992822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:56.998900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:56.999340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.000095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:57.000532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.134555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:57.144041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19705fb9-bc52-4d8b-9119-2c43c5ce1a54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155561 Jun 15 10:52:57.144731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1484/3070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:57.348072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:57.348617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:57.354790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:57.355239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.355994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:57.356429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.492945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:57.502606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:57.504115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:57.505329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30052c84-c123-4519-aead-b7e2a931adff tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.161349 Jun 15 10:52:57.505893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1587/3071] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:57.571792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:57.572428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:57.579116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:57.579894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.580414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:57.580874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:57.720895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:57.729532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9d02b3e-16e5-4751-8e6e-4b3f14da788f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161614 Jun 15 10:52:57.730109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1485/3072] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:58.162169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:58.162783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:58.164725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=76 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:52:58.169751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.174268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.174268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.174268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.309914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:58.318697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6b5796e-8c10-438d-b4f7-45b078ef209f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160470 Jun 15 10:52:58.319273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1588/3073] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:58.524353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:58.524983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:58.531857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.532359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.533505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.534076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.687623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:58.697754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:58.699231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:58.700414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02a526dc-9ba0-401d-bbc6-acf33b34803f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.180135 Jun 15 10:52:58.701615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1486/3074] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:52:58.747564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:58.748156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:58.755854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.756292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.757137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:58.757565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:58.898707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:58.908242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3a94fa5-ebb9-4621-9375-0aef938157f7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164280 Jun 15 10:52:58.908829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1589/3075] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:52:59.335809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:59.336423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:59.342859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.343299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:59.344061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.345521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:59.494337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:59.504003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf7d015b-3397-437f-8fe6-5707d51f3bde tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.171515 Jun 15 10:52:59.504805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1487/3076] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:52:59.721465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:59.722069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:59.728435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.728877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:59.729672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.730090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:59.877739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:59.887132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:59.888870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:52:59.890183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f901c78-b247-427b-880b-4b73012c2f04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.173872 Jun 15 10:52:59.890747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1590/3077] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:52:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:52:59.926404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:52:59.927024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:52:59.933881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.934331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:52:59.935158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:52:59.935594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:00.086602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:00.096587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1c41ca26-93e6-42fe-8970-78ae21f8c0c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.174467 Jun 15 10:53:00.097195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1488/3078] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:52:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:00.521602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:00.522211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:00.528531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:00.528997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:00.529766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:00.530232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:00.662902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:00.671098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f2566490-7a92-4a5f-aa77-0221999c3926 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153238 Jun 15 10:53:00.671683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1591/3079] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:00.910164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:00.910679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:00.917229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:00.917678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:00.918463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:00.918898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:00.940262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:01.063127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:01.071646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:01.073135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:01.074281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a628ff9e-f3f4-4956-8252-690283d084f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.169064 Jun 15 10:53:01.074829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1489/3080] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:01.115012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:01.115624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:01.122412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:01.122860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:01.123629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:01.124185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:01.257165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:01.265301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d317b54-e9d3-4b07-b06a-5ae004222e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154243 Jun 15 10:53:01.265871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1592/3081] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:01.689235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:01.689849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:01.696036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:01.696479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:01.697272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:01.697705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:01.834218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:01.842505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11192cb0-e41e-4949-ae77-f725cc9c4f86 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157353 Jun 15 10:53:01.843062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1490/3082] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:02.093463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:02.093998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:02.101173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.101621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:02.102389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.102833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:02.238121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:02.246772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:02.248300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:02.249507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0abb92d-4370-416e-af1d-0250eb15ff10 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160681 Jun 15 10:53:02.250070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1593/3083] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:02.284730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:02.285426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:02.291868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.292320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:02.293117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.293558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:02.426917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:02.435121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d75e5de-7066-4265-ba2c-b90526cb6cf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154775 Jun 15 10:53:02.435680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1491/3084] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:02.860329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:02.861236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:02.867702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.868174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:02.868976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:02.869426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:03.006024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:03.014218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ea89f33e-a61d-4ce1-8c61-4ea917cfbf9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158203 Jun 15 10:53:03.014825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1594/3085] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:03.268920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:03.269556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:03.275724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:03.276174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:03.276940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:03.277450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:03.411359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:03.419954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:03.421466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:03.422638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb865344-e584-4094-9ff6-74540219e028 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158840 Jun 15 10:53:03.423203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1492/3086] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:03.454484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:03.455284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:03.461716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:03.462163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:03.462929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:03.463356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:03.605356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:03.614797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c67cbf87-cdd7-4e92-b979-0e662a916782 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164815 Jun 15 10:53:03.615626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1595/3087] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:04.031202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:04.031951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:04.038442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.038888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.039639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.040069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.176205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:04.184288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-525d59bc-c145-48c2-b371-0832479c0714 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156904 Jun 15 10:53:04.184848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1493/3088] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:04 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:04.441588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:04.442110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:04.448183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.448631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.449534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.449974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.590727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:04.600408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:04.601956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:04.603205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd635ade-8915-409b-a3f5-185734f9c638 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166203 Jun 15 10:53:04.603808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1596/3089] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:04.635770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:04.636483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:04.643315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.643757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.644517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:04.644947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:04.779054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:04.787873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb047e78-964c-498e-a653-1663796f3ba6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156042 Jun 15 10:53:04.788437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1494/3090] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:05.204792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:05.205439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:05.212331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.212789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.213598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.214037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.348925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:05.357178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-16442e19-970f-47f8-93c2-e22b8ba69e3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157250 Jun 15 10:53:05.357757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1597/3091] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:05.621841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:05.622350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:05.629673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.630116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.630881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.631311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.769604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:05.778278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:05.779741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:05.780884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5c047ef-b92a-48d4-83bb-bbe5f3a8e352 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.163025 Jun 15 10:53:05.781474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1495/3092] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:05.805831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:05.806429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:05.813472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.814235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.814880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:05.815307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:05.946347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:05.954634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9245bbd4-65b5-4f4b-a03f-4df730c37b7d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152581 Jun 15 10:53:05.955198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1598/3093] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:06.374774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:06.375518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:06.382258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.382708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:06.383487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.383926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:06.527470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:06.536289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-11295faa-46fd-4ca8-a9c3-6b25d5fddd9f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165375 Jun 15 10:53:06.536945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1496/3094] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:06.799915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:06.800569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:06.806759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.807361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:06.807932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.808361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:06.943445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:06.951731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:06.953222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:06.955525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-606d4150-361c-4f95-a403-a362218255a1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159902 Jun 15 10:53:06.956086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1599/3095] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:06.971756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:06.972393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:06.978950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.979398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:06.980160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:06.980597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:07.111440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:07.119756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce89bca2-4c86-498b-b2d0-784b9bb8a590 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151728 Jun 15 10:53:07.120406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1497/3096] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:07.553813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:07.554419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:07.560593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:07.561075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:07.561841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:07.562275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:07.694083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:07.702358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23fb48cf-b904-468f-8d5f-5aed36bfe548 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152463 Jun 15 10:53:07.702922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1600/3097] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:07.973527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:07.974194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:07.980722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:07.981204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:07.981967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:07.982401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:08.117739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:08.127011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:08.128499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:08.129816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9246b991-036b-470c-ba35-056cd0119655 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160164 Jun 15 10:53:08.130365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1498/3098] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:08.137774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:08.138508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:08.145244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:08.145686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:08.146471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:08.146902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:08.287728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:08.296057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f9bac3f3-5778-46b7-9982-f9ed7e2ab3c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162026 Jun 15 10:53:08.296640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1601/3099] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:08.722727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:08.723328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:08.733259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:08.733706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:08.734486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:08.735329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:08.867733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:08.876149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c81d4a0-0ecc-4948-9a21-dcc0005ba239 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158240 Jun 15 10:53:08.876670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1499/3100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:09.148538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:09.149147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:09.156942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.157561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:09.158357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.158873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:09.163007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:09.298221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:09.306681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:09.313621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:09.313621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c81f8c0-2df7-47e4-b750-30392e6dade2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.164918 Jun 15 10:53:09.313621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1602/3101] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:09.315311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:09.315934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:09.322606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.323056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:09.323979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.324335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:09.459001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:09.467378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3626a2eb-32b5-4fa5-b59e-16472c4547c9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156808 Jun 15 10:53:09.467949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1500/3102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:09.892858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:09.893495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:09.899822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.900266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:09.901064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:09.901501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:10.029624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:10.038108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3127656-6c2d-4ede-9842-9c0ae185c11a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149104 Jun 15 10:53:10.038698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1603/3103] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:09 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:10.328860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:10.329686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:10.336251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:10.336699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:10.337492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:10.337923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:10.464112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:10.473176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:10.474657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:10.475814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2dbd9f10-6520-4cd8-b95d-b57c90bc0c20 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.151575 Jun 15 10:53:10.476370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1501/3104] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:10.486493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:10.487105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:10.493644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:10.494082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:10.494840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:10.495275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:10.625935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:10.633927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b67a1526-57f3-4d07-b01b-bbe47d921091 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151213 Jun 15 10:53:10.634499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1604/3105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:11.056767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:11.057403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:11.064117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.064566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.065355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.065788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.197494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:11.206091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c065d67d-fc8a-4ab7-84bb-8a8c2b3df5ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153268 Jun 15 10:53:11.206645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1502/3106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:11 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:11.494312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:11.494922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:11.501595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.502039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.502800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.503231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.644176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:11.651456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:11.652069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:11.652822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:11.654429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:11.655612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f65fbe9-2c99-4544-a3b1-83f45fab8c36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.165161 Jun 15 10:53:11.656157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1605/3107] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:11.659262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.659711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.660476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:11.660908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:11.794134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:11.802309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6bcdb2f1-80ea-4690-9e98-afad3e2f3400 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154615 Jun 15 10:53:11.803370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1503/3108] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:12.228385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:12.229023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:12.235067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.235629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.236395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.236827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.371314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:12.379971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b90cc96c-7fa1-4442-a170-911b0139f540 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160397 Jun 15 10:53:12.380546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1606/3109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:12 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:12.674555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:12.675697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:12.682343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.682791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.683552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.683985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.814582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:12.819788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:12.820414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:12.823276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:12.824756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:12.825954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8e380d04-e0ab-4c8d-b691-a38c71f31903 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.155285 Jun 15 10:53:12.826498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1504/3110] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:12.827219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.827670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.829105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:12.829510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:12.958641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:12.966807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ed4d8db-d7f7-40bf-809b-87f7cbabc22b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151004 Jun 15 10:53:12.967365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1607/3111] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:13.397934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:13.398543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:13.404556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.405035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.409602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.409602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.545872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:13.554186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2a555acf-49cc-4e2f-957f-45851e697c3b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160205 Jun 15 10:53:13.554753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1505/3112] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:13.845995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:13.846560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:13.853172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.853624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.854413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.854889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.984465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:13.985035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:13.987596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:13.991810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.992260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.993091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:13.993532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:13.997566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:13.997737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:13.999081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:14.001353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edad50a6-d6d6-4823-91ca-46be4d54a091 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158951 Jun 15 10:53:14.001788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1608/3113] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:14.122284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:14.131304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-70b241b6-6a64-446d-9316-2fa0b6406bed tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150947 Jun 15 10:53:14.131858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1506/3114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:14.571739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:14.572324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:14.579025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:14.579476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:14.580232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:14.580677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:14.712088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:14.721058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e33cc1d-adaa-4271-9770-55fd7bc7f4f7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153395 Jun 15 10:53:14.721629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1609/3115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:15.019873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:15.020536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:15.027046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.027502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.028265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.028706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.148135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:15.148857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:15.155326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.155751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.157727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.158453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.164761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:15.173345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:15.175269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:15.175982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-268443a5-74e9-45dd-a754-07340e26fb8d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160612 Jun 15 10:53:15.176534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1507/3116] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:15.291808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:15.300875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7122b2a1-bb59-4f55-9c5a-25f80d7845e8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156772 Jun 15 10:53:15.301516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1610/3117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:15.738805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:15.739545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:15.745743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.746181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.746940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:15.747362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:15.890511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:15.898696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-260850e3-6bb1-4a98-b5bd-6bdedd777312 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164298 Jun 15 10:53:15.899255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1508/3118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:16.194383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:16.194941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:16.201541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.201983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:16.202740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.203490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:16.318908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:16.319674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:16.326098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.326647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:16.327335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.327761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:16.337795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:16.349081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:16.350580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:16.351759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-14a45aaf-384c-47a0-a023-8b932e21b66c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.161376 Jun 15 10:53:16.352321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1611/3119] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:16.460428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:16.469613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-decc85f7-c336-408d-89b8-33f89fa09bfe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153994 Jun 15 10:53:16.470241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1509/3120] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:16.915922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:16.916441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:16.923527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.924058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:16.924817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:16.925286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:17.052656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:17.060619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c281029-2132-425e-821c-e946d1417004 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148629 Jun 15 10:53:17.061213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1612/3121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:16 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:17.371163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:17.371775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:17.378510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:17.378952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:17.379709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:17.380145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:17.487128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:17.487747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:17.494489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:17.494940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:17.495731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:17.496218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:17.518115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:17.526802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:17.528285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:17.529473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0685b28-c0d6-4ec0-9962-36b150eb019d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162251 Jun 15 10:53:17.530056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1510/3122] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:17.632508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:17.640477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0351f12c-fcb4-421c-a068-9eb78d6f0816 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157387 Jun 15 10:53:17.641703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1613/3123] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:18.077777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:18.078399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:18.085306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.085746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.086887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.087310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.221922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:18.230030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a1e52300-818b-47bd-a53a-69583797cfbe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156124 Jun 15 10:53:18.230597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1511/3124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:18.549241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:18.549842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:18.556493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.556932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.557714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.558148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.658961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:18.659765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:18.666637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.667082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.667866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:18.668307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:18.697820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:18.706813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:18.708290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:18.709479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bacaefe5-6774-46b4-b70c-3d3412b0bf51 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.165556 Jun 15 10:53:18.710319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1614/3125] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:18.805243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:18.813838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-653390fd-3096-44ad-aa61-7b24fe0a4279 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158785 Jun 15 10:53:18.814407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1512/3126] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:19.249943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:19.251310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:19.257647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.258093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.258893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.259324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.408604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:19.418069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8dd2efd0-8476-4ef5-bbfd-9d7f3cd35de9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.173910 Jun 15 10:53:19.418650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1615/3127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:19.729792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:19.730413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:19.737097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.737548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.738317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.738759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.831752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:19.832371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:19.839171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.839882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.840645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:19.841112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:19.874437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:19.884027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:19.885528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:19.886690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-374286fc-2a59-413d-aa78-37594b502a38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160908 Jun 15 10:53:19.887325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1513/3128] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:19.977437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:19.985851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1ed0c97-0633-4872-9a6f-81ca7768ecaf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158483 Jun 15 10:53:19.986403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1616/3129] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:20.435707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:20.436327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:20.444176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:20.444623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:20.445442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:20.445876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:20.583960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:20.592588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2ea48f3-ebd0-4d65-b927-ce53a45887fe tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160667 Jun 15 10:53:20.593196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1514/3130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:20.905696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:20.906454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:20.913678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:20.914130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:20.914905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:20.915345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:21.003059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:21.003764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:21.011264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:21.011675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:21.012455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:21.012895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:21.056599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:21.065647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:21.067141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:21.068374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bbead5ee-4b4d-423d-9ccb-ad4553545867 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166621 Jun 15 10:53:21.069013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1617/3131] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:21.150534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:21.159353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fc74a79-64ae-45b8-aea2-fc33710b47b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160301 Jun 15 10:53:21.159928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1515/3132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:21.610510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:21.611158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:21.617446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:21.617886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:21.618644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:21.619072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:21.755864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:21.759312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:21.764122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-250aa6a0-d274-4cc4-8f83-a0a33b8a2849 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157959 Jun 15 10:53:21.764687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1618/3133] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:22.087885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:22.088490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:22.095450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.095889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.096656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.097308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.177462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:22.178063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:22.184872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.185364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.186222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.186643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.231656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:22.241468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:22.242957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:22.244137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f792331-9443-4f4c-8e16-b4144311424e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160198 Jun 15 10:53:22.244696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1516/3134] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:22.322921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:22.331209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b9460456-e65a-46d9-a660-a1b574d346d9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159168 Jun 15 10:53:22.331790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1619/3135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:22.788932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:22.789591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:22.796343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.796703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.798178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:22.798619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:22.946161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:22.954458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb0e3506-97a5-4c16-bf8d-f2ca809b1cef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.169452 Jun 15 10:53:22.955032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1517/3136] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:23.262413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:23.263041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:23.274090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:23.274532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:23.275320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:23.275744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:23.351549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:23.352605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:23.359139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:23.359626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:23.360531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:23.360849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:23.423605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:23.432703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:23.434272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:23.435462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b3eb478-5fe8-4491-9dea-c5084f1cc59c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.176992 Jun 15 10:53:23.436034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1620/3137] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:23.539031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:23.550007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99c93aec-5eb1-4139-83b3-db1e2ffa2af5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.202254 Jun 15 10:53:23.550707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1518/3138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:24.027758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:24.028360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:24.034674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.035129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.035869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.036295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.162816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:24.170834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-49210cb4-2c00-4b13-8dc3-39567946cb58 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.146921 Jun 15 10:53:24.171406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1621/3139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:24.454542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:24.455170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:24.462497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.462937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.463736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.464171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.567677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:24.568523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:24.575373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.575811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.576571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:24.577024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:24.598423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:24.606955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:24.608444 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:24.610358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa512174-0317-4376-87f5-91b26b2940b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.159334 Jun 15 10:53:24.610960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1519/3140] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:24.706314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:24.714239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-754e6416-f60b-4851-ba7f-6dd19491446a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150486 Jun 15 10:53:24.715082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1622/3141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:25.188547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:25.189256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:25.191280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=78 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:25.196141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.196616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.197418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.197894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.329003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:25.337096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aaf262fb-5684-44ca-87e1-f61b0365f3f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153172 Jun 15 10:53:25.337666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1520/3142] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:25 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:25.629348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:25.630079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:25.636416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.636855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.637637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.638069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.731599 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:25.732219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:25.739658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.740129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.740900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:25.741356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:25.773399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:25.782791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:25.784303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:25.785507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9cc0153f-2f0a-402b-a738-e80b6430d34f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160890 Jun 15 10:53:25.786251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1623/3143] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:25.873181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:25.881841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24ebaa04-9d01-4f8b-ab28-380b3faf4881 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154130 Jun 15 10:53:25.882396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1521/3144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:26.355692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:26.356336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:26.362458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.362906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.363670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.364109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.491721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:26.500932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4195417f-8b78-4456-b4e4-501b9c0c1f1e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148444 Jun 15 10:53:26.501528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1624/3145] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:26.804268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:26.804862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:26.814516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.816429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.817300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.817964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.899992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:26.900596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:26.907915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.908366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.909174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:26.909607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:26.954692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:26.958178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:26.963436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:26.965169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:26.966317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1b00a73-4f21-479c-8a42-9f989ff23a3c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166097 Jun 15 10:53:26.966872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1522/3146] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:27.044765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:27.052926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ef389e2-8932-4128-90d3-fd86111903b6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156842 Jun 15 10:53:27.053517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1625/3147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:27.519483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:27.520088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:27.526227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:27.526677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:27.527430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:27.527854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:27.657481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:27.665398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38e58097-9327-4029-8c01-00d5146fb534 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151139 Jun 15 10:53:27.665959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1523/3148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:27.986327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:27.986925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:27.993465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:27.993902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:27.994650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:27.995092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:28.070526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:28.071536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:28.078139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:28.078963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:28.079630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:28.080148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:28.123959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:28.133519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:28.135006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:28.136165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4009f5ed-a0ec-471c-9a67-e7abd7c2d976 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.154724 Jun 15 10:53:28.136715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1626/3149] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:28.217350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:28.226141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-922db9af-f162-46ef-ab85-dbd5bf9f0b38 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159599 Jun 15 10:53:28.226715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1524/3150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:28.682881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:28.683527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:28.685410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=78 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:28.690387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:28.690837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:28.691599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:28.692122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:28.823026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:28.831637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3d0d5ed-0d81-46dd-bc8b-da3be36ce391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152638 Jun 15 10:53:28.832192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1627/3151] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:29.154475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:29.155011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:29.161543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.161983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.162732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.163161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.244505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:29.245174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:29.252868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.253360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.254171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.254612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.294841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:29.304412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:29.306003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:29.307161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03730a91-6bf1-423f-985e-98110d5bb901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156627 Jun 15 10:53:29.307718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1525/3152] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:29.388882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:29.397767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6463b68-ea49-49aa-9066-5790a562c30f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157284 Jun 15 10:53:29.398368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1628/3153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:29.682047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:53:29.682279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:53:29.849467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:29.850074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:29.856510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.856986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.857798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:29.858282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:29.993211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:30.002164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0ab9e9c-d6d1-442e-895a-569f2c91a3c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156486 Jun 15 10:53:30.002716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1526/3154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:30.326173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:30.326837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:30.333740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:30.334189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:30.334957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:30.335390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:30.415624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:30.416281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:30.422805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:30.424323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:30.425666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:30.426114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:30.469976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:30.479940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:30.481432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:30.482588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ee73694-7796-4655-93fb-a4cb035bac76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160343 Jun 15 10:53:30.483436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1629/3155] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:30.567113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:30.576246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f2a24e4c-614e-45af-9937-fe50d58f251f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164376 Jun 15 10:53:30.576815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1527/3156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:31.019409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:31.020154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:31.026524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.026995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.027829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.028295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.163418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:31.171700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-582f7211-00c8-45e6-84b8-d5079a168e0b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156425 Jun 15 10:53:31.172258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1630/3157] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:31 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:31.502741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:31.503440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:31.509949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.510391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.511148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.511576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.595089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:31.596471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:31.603282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.603713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.604500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:31.604928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:31.642864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:31.651648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:31.653211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:31.654335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5809f399-3bb5-4002-8d4e-eb87d0f1d37f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156306 Jun 15 10:53:31.654893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1528/3158] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:31.737807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:31.745855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5eb6f0e7-1294-4bdb-b0ff-3ade34839fe9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154597 Jun 15 10:53:31.746410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1631/3159] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:32.190120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:32.190722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:32.196926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.197425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.198182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.198612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.331447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:32.339476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a204602a-9e4e-481f-87d8-a7fc1f3c9fc3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154014 Jun 15 10:53:32.340293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1529/3160] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:32 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:32.672768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:32.673466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:32.680824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.681301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.682057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.682485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.763493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:32.764105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:32.772077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.772515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.773300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:32.773758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:32.819466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:32.829215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:32.831960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:32.833341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3a60e29-8c6b-4f44-a5fb-572828afc302 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.164382 Jun 15 10:53:32.834437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1632/3161] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:32.909390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:32.917726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f9699b1-47da-42fe-84f6-3b66bb87e728 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157967 Jun 15 10:53:32.918412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1530/3162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:33.357871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:33.358477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:33.365621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.366059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.366812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.367245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.502154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:33.510656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e2a8b2b8-df23-4b66-a0d2-69a194a93906 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156703 Jun 15 10:53:33.514663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1633/3163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:33.854489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:33.865113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:33.865113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.865113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.865113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.865494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.935714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:33.936332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:33.943389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.943565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.944334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:33.944769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:33.999902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:34.008724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:34.010268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:34.011433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5d4455fb-2773-4b06-8429-57209162a019 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.160880 Jun 15 10:53:34.011994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1531/3164] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:34.074764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:34.083417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db915db7-e718-486f-b972-cadc2950d888 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151551 Jun 15 10:53:34.083976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1634/3165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:34.528026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:34.528640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:34.535205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:34.535651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:34.536443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:34.536875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:34.663473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:34.671493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8485edba-7b9b-4c06-856d-f82fe3f05fce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.147449 Jun 15 10:53:34.672034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1532/3166] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:35.030360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:35.038502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:35.038502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.038775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.039849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.040289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.058905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:35.101616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:35.102264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:35.109049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.109496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.110418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.110913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.179719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:35.189373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:35.191572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:35.192737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0d29225-4409-424a-8033-2782129e1472 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.166313 Jun 15 10:53:35.193324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1635/3167] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:35.251342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:35.259327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c5b849f0-741d-432b-8b6e-14ebc3339200 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161588 Jun 15 10:53:35.259880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1533/3168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:35.688834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:35.689385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:35.695813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.696257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.697043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:35.697481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:35.832203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:35.840420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d177cf40-b556-4140-aa67-c1f0e0b003c2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155590 Jun 15 10:53:35.840992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1636/3169] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:36.211703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:36.212289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:36.219157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.219597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:36.220350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.220803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:36.276982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:36.277599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:36.284771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.285261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:36.286036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.286473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:36.359094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:36.368388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:36.369890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:36.371061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f71b3f83-69a2-418a-937c-c8f73d17fb2b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.163241 Jun 15 10:53:36.371616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1534/3170] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:36.422139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:36.430845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1341deb9-e2e7-481d-8583-abddfa4e2dd4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157733 Jun 15 10:53:36.431411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1637/3171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:36.858359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:36.858886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:36.866010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.866458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:36.867243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:36.867680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:37.004741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:37.012936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c3cdd07-0178-4e63-9a66-72492e3498a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158517 Jun 15 10:53:37.013526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1535/3172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:37.389911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:37.390545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:37.397639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:37.398086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:37.398847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:37.399306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:37.449051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:37.449718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:37.457182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:37.458432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:37.459247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:37.459688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:37.528936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:37.539848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:37.541931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:37.542869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c346aac8-c6f4-4ad8-8551-7382cca0802f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.156894 Jun 15 10:53:37.543447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1638/3173] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:37.594082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:37.602337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2cb31db6-140e-4c70-b5b8-d9f3848388a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157307 Jun 15 10:53:37.602894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1536/3174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:38.029793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:38.030400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:38.036940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.037411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.038169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.038596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.173148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:38.182515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f95ee83c-1175-4827-9a52-fa5d1be79495 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156363 Jun 15 10:53:38.183093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1639/3175] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:38 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:38.561036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:38.561644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:38.568291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.568739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.569536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.569973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.621295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:38.621908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:38.628736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.629472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.629753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:38.630190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:38.705976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:38.715833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:38.717881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:38.719268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9527dfa0-7998-49c1-9aaa-5de5254ac030 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162201 Jun 15 10:53:38.719820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1537/3176] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:38.766652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:38.775796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-15df3b07-629a-4b06-bd34-e5cf73293909 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158368 Jun 15 10:53:38.778181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1640/3177] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:39.124979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:53:39.125203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:53:39.200373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:39.200911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:39.208519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.208986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.209961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.210457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.350656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:39.358786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07b89c5c-763c-4eac-88ab-e5dfa5ee5270 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.162630 Jun 15 10:53:39.359353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1538/3178] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:39.739519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:39.740184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:39.746846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.747286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.748038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.748464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.794390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:39.795116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:39.803114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.803569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.804347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:39.804783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:39.823664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:39.881998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:39.890572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:39.892054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:39.893239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b25cb29f-b66e-45f0-8c22-b774ce3f1794 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158128 Jun 15 10:53:39.893788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1641/3179] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:39.937080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:39.945224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42484fef-f07d-416f-9cbd-198966c099a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154732 Jun 15 10:53:39.945780 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1539/3180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:40.376687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:40.377463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:40.384027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.384473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:40.385261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.385698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:40.742558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:40.751414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-faf5c71b-31cf-4932-b378-f9d3d98555b8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.378639 Jun 15 10:53:40.751984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1642/3181] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:40.913345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:40.913948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:40.920665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.921173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:40.922029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.922580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:40.962694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:40.963307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:40.969939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.970385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:40.971162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:40.971596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:41.068608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:41.077232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:41.078714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:41.079887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-692faa3d-1c0e-4c88-934a-b61b95183f34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.171734 Jun 15 10:53:41.080451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1540/3182] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:41.104436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:41.112420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ca50fa0b-634a-4f24-99fe-af4ea87752bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153697 Jun 15 10:53:41.113711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1643/3183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:41.770907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:41.771539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:41.777761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:41.778207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:41.778960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:41.779388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:41.917716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:41.930582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab8ec917-e63c-43b3-bcab-c063ef3c8539 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163522 Jun 15 10:53:41.931227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1541/3184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:42.098910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:42.099440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:42.106002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.106446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:42.107200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.107636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:42.130574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:42.131183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:42.137283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.137728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:42.138492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.138934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:42.252860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:42.264102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:42.268538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:42.268538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f212ac5-1dc8-48b5-b203-32f7c0b81e14 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.172495 Jun 15 10:53:42.268538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1644/3185] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:42.298733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:42.307057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e00d4389-865c-4e92-8a4e-8a0fc32ab21b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.180596 Jun 15 10:53:42.307622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1542/3186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:42 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:42.948516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:42.949058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:42.955094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.955539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:42.956292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:42.956724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:43.089248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:43.097425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73f4377f-53c6-46b5-9fd5-11430f4cd46f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152879 Jun 15 10:53:43.097996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1645/3187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:43.286414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:43.287112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:43.293814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:43.294266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:43.295140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:43.295581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:43.323393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:43.324061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:43.330635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:43.331074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:43.331891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:43.332329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:43.438360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:43.447608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:43.449143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:43.450527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da2fa156-4e8d-473f-bc27-bcc5a5507b32 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.168660 Jun 15 10:53:43.451093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1543/3188] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:43.472901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:43.481792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3d14a189-21b1-488d-82b9-ca4c1bbd46ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162108 Jun 15 10:53:43.482404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1646/3189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:44.115585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:44.116133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:44.122329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.122806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.123653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.124089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.253052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:44.261646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-adb3a46a-0d83-4063-9e6c-0be0ab893f8b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150829 Jun 15 10:53:44.262203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1544/3190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:44.469207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:44.469813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:44.476623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.477089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.477840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.478264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.503179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:44.503907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:44.511135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.511590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.512357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:44.512788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:44.608340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:44.618092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:44.619563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:44.620711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5b0100ae-55e3-4958-b2ba-c08a3857795e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.155555 Jun 15 10:53:44.621347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1647/3191] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:44.647669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:44.655578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e2fead0e-6867-462c-a482-87a752b86e68 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156222 Jun 15 10:53:44.656133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1545/3192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:45.279794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:45.280408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:45.287711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.288272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.289088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.289532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.427284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:45.435503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe6a3c1f-9eed-40f0-b46f-4fe409b29c92 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159797 Jun 15 10:53:45.436175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1648/3193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:45 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:45.645150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:45.645150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:45.648784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.649254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.650014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.650442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.673444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:45.674047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:45.681233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.681675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.682435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:45.682856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:45.828756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:45.837233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a2fe4cf-a5e5-44a0-b538-eae322e77b90 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.167426 Jun 15 10:53:45.837818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1649/3194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:45.915727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:45.924383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:45.926015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:45.927761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0975042-943b-4a85-b19a-9ab31c3138c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.291551 Jun 15 10:53:45.928318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1546/3195] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:46.453845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:46.454448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:46.460741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.461225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:46.462081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.462446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:46.660656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:46.670353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93d4b2ad-b34f-48ca-80e0-200278cf936e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.220650 Jun 15 10:53:46.670929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1650/3196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:46.855889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:46.856508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:46.863164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.863656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:46.864813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.865273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:46.947204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:46.947606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:46.954111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.954674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:46.955448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:46.955884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:47.004092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:47.013063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ab1f880d-b8f6-44d5-a6e7-47bb28ab1c44 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160997 Jun 15 10:53:47.013640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1547/3197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:47.090872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:47.100433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:47.101950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:47.103115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-58ac9115-8daf-4967-a953-e830ae8d4584 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.161014 Jun 15 10:53:47.103667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1651/3198] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:47.688122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:47.688843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:47.695070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:47.695506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:47.696258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:47.696686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:47.836178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:47.844778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27f1f7fc-1215-477b-aeea-bec341d11bd3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160439 Jun 15 10:53:47.845376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1548/3199] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:48.031131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:48.031720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:48.039364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.039796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:48.040579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.041031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:48.045024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:48.121824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:48.122436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:48.129349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.129795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:48.130567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.131297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:48.175134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:48.184052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b6678396-ac81-49a9-8878-e3f17393ecc8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156812 Jun 15 10:53:48.190559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1652/3200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:48.265004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:48.274007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:48.275487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:48.276649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99dbf360-ade7-4807-9a06-0bc679a7dec6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.158722 Jun 15 10:53:48.277232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1549/3201] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:48.863107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:48.863710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:48.871446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.877780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:48.877780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:48.877780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:49.009469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:49.017767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48e74739-e921-4c10-9023-fd5bfef2acab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158680 Jun 15 10:53:49.018331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1653/3202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:49.202044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:49.203051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:49.210427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:49.210873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:49.211669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:49.212103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:49.295651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:49.296335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:49.303425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:49.303966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:49.304839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:49.305309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:49.347998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:49.356776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f35ab0d2-2bfd-454e-9613-f418c04da052 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158569 Jun 15 10:53:49.357380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1550/3203] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:49.442002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:49.451412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:49.452887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:49.454116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6ae332f4-a5ae-4c1c-b815-c907bb170a37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.162251 Jun 15 10:53:49.454668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1654/3204] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:50.035970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:50.036498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:50.043610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.044057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.045168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.045613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.334575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:50.343496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b261814-c2b4-48e4-af3b-900a65d98dd8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.311552 Jun 15 10:53:50.344066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1551/3205] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:50 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:50.374503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:50.375158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:50.383470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.383921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.384698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.385165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.474007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:50.474872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:50.481484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.482180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.482958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:50.483391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:50.527521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:50.535453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19f1b2b3-f476-4cd0-8fd0-8ec98eb3cf89 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164728 Jun 15 10:53:50.547177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1655/3206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:50.669345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:50.679613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:50.681231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:50.682454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7aadc8ef-2ff9-4a11-aa98-731b2f57afa8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1801 microversion: 2.20 time: 0.212570 Jun 15 10:53:50.683014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1552/3207] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:51.120064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68397bf4-b7e5-40fa-a541-3a52382f6fcc", "name": "network-vif-deleted", "tag": "930c8b3e-468b-45e6-9344-ea15102d343c"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:53:51.134616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.135056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.152876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] Creating event network-vif-deleted:930c8b3e-468b-45e6-9344-ea15102d343c for instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc on hv-cinder-84580 Jun 15 10:53:51.157175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR oslo.messaging._drivers.impl_rabbit [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] [8c4c0f74-2444-4e17-a468-8075815c5b88] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 10:53:51.361009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:51.361573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:51.368520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.368987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.369753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.370189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.515656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:51.524733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf966b0c-85e5-4328-956e-796478c494d3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.167693 Jun 15 10:53:51.525672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1553/3208] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:51.554636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:51.555257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:51.561440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.561890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.562665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.563102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.697297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:51.705647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-51a31948-c8a1-443a-83a3-9d1f3c14a5ae tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155171 Jun 15 10:53:51.706210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1554/3209] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:51.711830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:51.712428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:51.718948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.719393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.720162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:51.720583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:51.785000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:51.794706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:51.796190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:51.797359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3419df36-d459-4f7a-89a0-d21025ff545f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090214 Jun 15 10:53:51.797918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1555/3210] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:52.142247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:53:52.142513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:53:52.164067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] [8c4c0f74-2444-4e17-a468-8075815c5b88] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 37558. Jun 15 10:53:52.167504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-e774fc26-e666-4688-bd21-f90fcae1fa76 req-d70f9800-5885-4307-b1b2-db4224566242 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.111612 Jun 15 10:53:52.177991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1656/3211] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:53:52.543502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:52.543953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:52.550594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.551034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.551800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.552232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.556372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:52.685393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:52.693360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-add5a633-2afd-4c48-a5c6-4dc9f0b84d5d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153925 Jun 15 10:53:52.694106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1556/3212] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:52.724579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:52.726428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:52.732567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.733070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.733820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.734246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.816411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:52.817435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:52.824776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.825269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.826049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:52.826490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:52.874338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:52.883426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70ff9b86-cb24-4c40-9b84-432237345791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163385 Jun 15 10:53:52.883996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1657/3213] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:52.890639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:52.899967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:52.901445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:52.902568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3276d2a-6258-4646-a48d-58a51e5dbb9f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090417 Jun 15 10:53:52.903106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1557/3214] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:53.710956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:53.711762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:53.718071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.718513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.719357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.720120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.853762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:53.861811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79d01135-ca05-469b-b4df-6e80a19b29c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154931 Jun 15 10:53:53.862374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1658/3215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:53.901301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:53.901988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:53.908408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.908880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.909659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.910089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.920387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:53.921012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:53.927090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.927535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.928861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:53.929335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:53.991275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:53.999971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:54.001511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:54.002695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-71b37206-20ba-4a66-8489-51e5e9f21e7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086255 Jun 15 10:53:54.003249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1659/3216] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:54.043632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:54.051870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aad08b7c-e56e-447b-b351-afe0a7da50d0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154741 Jun 15 10:53:54.052432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1558/3217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:54.880054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:54.880643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:54.887716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:54.888168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:54.888922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:54.889384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:55.020093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:55.020602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:55.020747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:55.027164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:55.027611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:55.028720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:55.029415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:55.031984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-11ac9ada-1a7d-4787-b7cf-71fd4a102f43 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155426 Jun 15 10:53:55.033019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1660/3218] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:55.070329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:55.070941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:55.077134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:55.077584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:55.078366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:55.078816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:55.096571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:55.106360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:55.107830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:55.108992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14801e9b-59f3-4af7-a1db-bcf95387b7dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092796 Jun 15 10:53:55.113658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1559/3219] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:55.213363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:55.221822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d1640176-2631-438e-93b4-634ad6daf05a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156230 Jun 15 10:53:55.222392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1661/3220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:56.049695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:56.050293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:56.052676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=80 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:56.057524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.057981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.058923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.059196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.127955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:56.128565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:56.135665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.136215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.137039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.137483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.194613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:56.200600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:56.203279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fecc49b-dee9-4068-8d14-6123434cfa55 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157417 Jun 15 10:53:56.203857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1560/3221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:56.209991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:56.211677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:56.212820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d00d8221-6c3d-49eb-b31a-11f4e12e1f3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088966 Jun 15 10:53:56.213408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1662/3222] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:56.239843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:56.241043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:56.247138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.247580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.248340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:56.248770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:56.377774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:56.385919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4613f494-e0ea-4e7d-aa6b-932246eee27c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149964 Jun 15 10:53:56.386476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1561/3223] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:57.221750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:57.222367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:57.229641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.230088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.230788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:57.231248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.231248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.231461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:57.237943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.238393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.239155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.239590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.309320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:57.317912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:57.319975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:57.321155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92378460-ed20-466e-a735-ccb1e1a03f56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094170 Jun 15 10:53:57.321709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1562/3224] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:53:57.367236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:57.375299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6c2e6fde-37cd-4bf8-9a33-ae339e083d75 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157336 Jun 15 10:53:57.375881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1663/3225] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:57 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:57.403144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:57.403752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:57.409865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.410309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.411056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:57.411485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:57.544153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:57.552146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64ee6c84-808e-43d6-af1c-681998d55899 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152826 Jun 15 10:53:57.552694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1563/3226] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:58.339044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:58.339903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:58.346511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.346956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.347713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.348148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.392634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:58.393445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:58.400321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.400866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.401645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.402078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.412688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:58.421268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:58.422751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:58.423887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b315b495-1abc-41da-a177-fed2f13ae17b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088759 Jun 15 10:53:58.424446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1664/3227] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:58.532212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:58.541177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-feaa9a3e-1497-4fc5-a317-e5e0e023ef25 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152317 Jun 15 10:53:58.541742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1564/3228] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:53:58.573389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:58.574000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:58.580054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.580500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.581294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:58.581725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:58.713415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:58.721634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dcc1b925-a7e5-4403-88e9-d6ec1e0ea192 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152126 Jun 15 10:53:58.722199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1665/3229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:59.442750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:59.443357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:59.450826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.451273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.452045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.452479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.517159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:59.526004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:59.527490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:59.528633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4afbbdd-d186-4fce-bfdd-bda2af97a77c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089951 Jun 15 10:53:59.529212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1565/3230] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:53:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:53:59.558726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:59.559338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:59.561788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=78 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:59.566547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.566990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.567754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.568180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.697598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:59.705730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67211cc8-6f3e-4fd2-b909-0424093702b2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150781 Jun 15 10:53:59.706282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1666/3231] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:53:59.739429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:53:59.740042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:53:59.746784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.747226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.748065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:53:59.748416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:53:59.876403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:53:59.885031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b27320c7-7ef4-4575-a818-e632c6943f8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149369 Jun 15 10:53:59.885594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1566/3232] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:53:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:00.545998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:00.546600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:00.552854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.553363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:00.554143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.554575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:00.618931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:00.627232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:00.628697 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:00.629849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1ea3bcc-5066-4a31-a877-7827a9e06ab6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087784 Jun 15 10:54:00.630402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1667/3233] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:00.723483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:00.724093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:00.731249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.733191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:00.733191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.733191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:00.864222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:00.873132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64295c7f-7b7e-4615-85c1-7358b2d36e29 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153406 Jun 15 10:54:00.873713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1567/3234] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:00.901399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:00.902006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:00.908608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.909079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:00.909840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:00.910270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:01.042513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:01.050552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d53bcbfb-9b89-4541-bf0b-e8d45c929de0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153096 Jun 15 10:54:01.051112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1668/3235] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:01.649192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:01.649799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:01.655902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:01.656356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:01.657140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:01.657577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:01.722302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:01.732100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:01.733597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:01.734729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8379a694-583f-4e00-b785-dd8176c6501d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090283 Jun 15 10:54:01.735288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1568/3236] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:01.890826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:01.891438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:01.898723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:01.899170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:01.899930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:01.900362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:01.918251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:02.028233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:02.036237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47e9d04d-cecf-4036-a2ee-1ce891ac84f2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149257 Jun 15 10:54:02.036797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1669/3237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:02.067987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:02.069181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:02.075125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:02.075596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:02.076354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:02.076785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:02.211263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:02.219800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbe62848-2fdc-4a98-89b3-af7e37479351 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155603 Jun 15 10:54:02.220358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1569/3238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:02.753175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:02.753790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:02.759998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:02.760478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:02.761276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:02.761739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:02.822400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:02.831156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:02.832682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:02.833921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-abc11f37-ac83-48bc-b365-856c079435e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.084619 Jun 15 10:54:02.834558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1670/3239] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:03.053508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:03.054071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:03.060534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.061013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.061772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.062203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.189591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:03.197636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4880bb9c-bfaa-4559-9a8b-37be6c78310e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148089 Jun 15 10:54:03.198198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1570/3240] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:03 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:03.237433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:03.238060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:03.244649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.245133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.245889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.246345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.378054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:03.386575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb230ab3-7d32-4e22-9d36-89e294ca8b8c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152917 Jun 15 10:54:03.387125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1671/3241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:03.852605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:03.853273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:03.859562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.860768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.860768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:03.861276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:03.929895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:03.939729 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:03.941220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:03.942364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa2ec13a-bf40-409c-be9a-7fd09d1d5121 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093834 Jun 15 10:54:03.942950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1571/3242] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:04.215698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:04.216322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:04.222549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.222987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:04.223736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.224164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:04.354284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:04.362469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f317d37b-342b-4b8a-81e4-d235b2048d0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150923 Jun 15 10:54:04.363033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1672/3243] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:04 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:04.403761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:04.404371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:04.410821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.411262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:04.412019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.412452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:04.541540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:04.545013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:04.549810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-84346256-5ca2-4614-835f-cae212c49fbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149896 Jun 15 10:54:04.550371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1572/3244] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:04.961360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:04.961975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:04.968250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.968821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:04.969485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:04.969920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:05.030994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:05.040049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:05.050274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:05.050274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c6e56557-e491-48bb-9c22-13deb6c61bd4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085541 Jun 15 10:54:05.050274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1673/3245] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:05.379650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:05.380175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:05.386810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:05.387263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:05.388026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:05.388466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:05.516788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:05.525832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8e8c975-2c1e-4c15-9514-08e914cebbb0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150492 Jun 15 10:54:05.526405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1573/3246] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:05.567176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:05.567784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:05.574359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:05.574804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:05.575561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:05.575994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:05.711662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:05.720273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f2e6fef-3d14-4458-8c6e-5090ac8021c1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156897 Jun 15 10:54:05.720839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1674/3247] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:06.061582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:06.062186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:06.069555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.070013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.070765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.071194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.135070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:06.143430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:06.144883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:06.146036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-deb78e3f-480b-404b-916b-9ae38a5afdf5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088340 Jun 15 10:54:06.147273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1574/3248] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:06.543823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:06.544440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:06.550714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.551173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.551914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.552351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.681587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:06.689519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b06658d-7d7a-4ff1-9648-64e4552cac6b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149565 Jun 15 10:54:06.690084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1675/3249] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:06.737943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:06.738536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:06.746039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.746477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.747229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:06.747657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:06.880116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:06.888985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02e2c4e7-6996-4f0c-aeec-9e56a2e8d992 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154907 Jun 15 10:54:06.889552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1575/3250] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:07.164434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:07.164993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:07.171108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.171552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:07.172345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.172782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:07.236849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:07.246628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:07.248124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:07.249294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e1507eb-af49-4260-b456-df610c814d69 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089392 Jun 15 10:54:07.250156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1676/3251] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:07.707722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:07.708334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:07.715322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.715800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:07.716559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.717012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:07.845291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:07.854177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b39fc9a3-c65a-4092-80e8-a000e6f6238c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150226 Jun 15 10:54:07.854747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1576/3252] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:07.906514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:07.907118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:07.913614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.914049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:07.914800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:07.915225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:08.046068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:08.054217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-33d7721c-6b1c-4edb-b7e6-7d7d93f97a2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151705 Jun 15 10:54:08.054772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1677/3253] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:08.267816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:08.268313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:08.275215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:08.275655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:08.276410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:08.276840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:08.342869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:08.352327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:08.353838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:08.354985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3ac06d36-200e-4559-9c9d-2c54fbb48366 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091240 Jun 15 10:54:08.355549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1577/3254] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:08.871523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:08.872039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:08.878303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:08.878746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:08.879492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:08.879921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:09.011360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:09.019262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-945d41b4-1e7b-4cbc-8ecb-9692f7961fd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151716 Jun 15 10:54:09.019827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1678/3255] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:09.071858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:09.072489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:09.078971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:09.079408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:09.080159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:09.080587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:09.213518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:09.221889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db0c2aa1-9c83-420c-b14d-39ada359af84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154337 Jun 15 10:54:09.222458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1578/3256] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:09.372405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:09.373038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:09.379316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:09.379757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:09.380505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:09.380930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:09.446766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:09.455332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:09.456949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:09.458098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c25f317a-c69e-4cf3-94b4-93cd05c52dd1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089574 Jun 15 10:54:09.458649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1679/3257] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:10.036707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:10.037528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:10.043704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.044145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.044900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.045357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.175534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:10.184485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-89b8973c-01d5-4940-9ca1-5e89c3e87eee tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151631 Jun 15 10:54:10.185075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1579/3258] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:10 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:10.187396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:54:10.187540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:54:10.240443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:10.242127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:10.248698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.249172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.249924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.250382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.382462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:10.390555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4de19e22-2635-4635-bc8d-cb1c447baff5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153882 Jun 15 10:54:10.391124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1680/3259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:10.477979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:10.478628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:10.484846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.485370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.486136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:10.486579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:10.552530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:10.561597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:10.563197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:10.564360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59ba3f54-2a09-4d77-9120-c9b0fac85094 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091151 Jun 15 10:54:10.564904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1580/3260] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:11.201622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:11.202228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:11.208310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.208756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.210165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.210801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.338765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:11.347050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-427b35d0-6d5d-4a99-9c61-b784ab8562f9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149271 Jun 15 10:54:11.347609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1681/3261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:11 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:11.407458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:11.408060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:11.415246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.415683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.416430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.416860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.549239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:11.558440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-46e60b4c-f2d1-4149-9d4c-528cfa650d1d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154669 Jun 15 10:54:11.560557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1581/3262] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:11.582796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:11.583404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:11.589899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.590344 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.591100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:11.591536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:11.655642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:11.665303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:11.666774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:11.667893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-afd978ff-bf4a-4fa4-9fd0-200edc267b98 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088974 Jun 15 10:54:11.668437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1682/3263] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:12.363631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:12.364237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:12.370783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.371227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.372042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.372478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.502442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:12.511134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9cb5fb3f-0aab-46fa-8878-63f2702db491 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151417 Jun 15 10:54:12.511698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1582/3264] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:12 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:12.576066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:12.576719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:12.583414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.583899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.584606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.585657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.686888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:12.687834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:12.694259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.695558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.696739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:12.697218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:12.728521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:12.737346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7d4c4ef-d8b8-4d2a-a4d0-fd27f7225a78 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165021 Jun 15 10:54:12.737881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1683/3265] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:12.780879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:12.789526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:12.791006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:12.792156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57560937-4923-4f19-baac-be66179cf208 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.109279 Jun 15 10:54:12.792905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1583/3266] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:13.529796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:13.530405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:13.538980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.539235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.540493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.540934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.671681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:13.680323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6d0beffd-e1c7-49d1-b8fd-01de1120f076 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154446 Jun 15 10:54:13.680886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1684/3267] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:13.755697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:13.756250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:13.763608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.764052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.764813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.765291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.810523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:13.811389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:13.818018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.818560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.819247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:13.820017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:13.890392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:13.899799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:13.901355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:13.902547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6facf39d-b818-4188-b429-494ac063be66 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095923 Jun 15 10:54:13.903129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1685/3268] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:13.906604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:13.915398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4aa1ece7-f069-4720-9fc4-090048f20daf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163658 Jun 15 10:54:13.915967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1584/3269] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:14.698134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:14.698731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:14.704945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.705413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.706161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.706675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.710988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:14.837610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:14.845823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19c72a9b-010c-4311-b99c-1b76db6e69bd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151906 Jun 15 10:54:14.846390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1686/3270] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:14.920337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:14.920945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:14.927492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.927936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.929336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.929789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.933574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:14.934209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:14.940291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.940771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.941573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:14.941998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:14.994471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:15.003075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:15.004538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:15.005718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7e349678-9419-4da6-964e-b84cae9f32d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089325 Jun 15 10:54:15.006270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1585/3271] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:15.076031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:15.084517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1eb46e6a-3483-4a78-9ac0-b72332ad1060 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154694 Jun 15 10:54:15.086333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1687/3272] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:15.863875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:15.864476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:15.871873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:15.872322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:15.873108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:15.873537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:16.010272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:16.018409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb1927be-8079-4597-b77e-68f541e364fb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158356 Jun 15 10:54:16.018973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1586/3273] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:16.024263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:16.024876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:16.031447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:16.031886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:16.032675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:16.033095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:16.097766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:16.103064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:16.103674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:16.107398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:16.108910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:16.109684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:16.110081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7674764d-9189-4a9b-94c3-4169e8caab86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090591 Jun 15 10:54:16.110230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:16.110643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1688/3274] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:16.110872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:16.111321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:16.243213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:16.251590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-641522ea-1650-4b38-84c8-c7a9722df653 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152747 Jun 15 10:54:16.252171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1587/3275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:17.035737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:17.036429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:17.043632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.044079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.044825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.045281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.130500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:17.130500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:17.137475 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.137924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.138738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.139222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.180934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:17.191779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-367b818b-29b4-4fad-b8b9-43c1a9c98737 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159774 Jun 15 10:54:17.192407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1689/3276] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:17 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:17.213216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:17.223241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:17.224949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:17.226843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6992cdb-3991-44be-b21a-5427c71fe588 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.101947 Jun 15 10:54:17.227653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1588/3277] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:17.268939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:17.273827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:17.276031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.276486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.277253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:17.277684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:17.406232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:17.414646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5623edae-933e-4c6f-b011-3e25588dc101 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149542 Jun 15 10:54:17.415213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1690/3278] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:18.210497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:18.211172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:18.218288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.218731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.219479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.219907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.238732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:18.245741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:18.252712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:18.253264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.253624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.254379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.254811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.323990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:18.332751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:18.334372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:18.336139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c49f128-cf4d-4329-aeb3-d7a001879cf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094993 Jun 15 10:54:18.336770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1691/3279] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:18.357675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:18.365685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f077bd34-7526-417a-87fb-1432c9c7674d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159787 Jun 15 10:54:18.366273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1589/3280] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:18.431548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:18.432190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:18.438219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.438665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.439422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:18.439861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:18.570617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:18.578885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-029150ff-4366-46bd-92e1-513f6c1e9f9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151145 Jun 15 10:54:18.579447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1692/3281] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:19.354243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:19.354846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:19.361600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.362048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.362841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.363274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.384308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:19.384942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:19.391595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.392182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.392888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.393356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.425662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:19.435853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:19.437519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:19.438692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aad0901f-8062-4c5d-aef5-1f9fe2f292c8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088445 Jun 15 10:54:19.439258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1590/3282] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:19.530131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:19.542540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c62f6d0e-a82d-4f22-b781-f561fada517f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.162819 Jun 15 10:54:19.543128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1693/3283] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:19.596762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:19.597396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:19.604677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.605152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.605912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:19.606344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:19.756066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:19.764509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a55dadc4-1c62-41a4-94d3-279c9f821747 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.171580 Jun 15 10:54:19.765207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1591/3284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:20.456995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:20.457631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:20.464868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.465341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.466113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.466677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.538949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:20.548256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:20.549831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:20.550985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84bbb4bd-5afa-4ac9-a59b-01e2f01f440c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.098041 Jun 15 10:54:20.551541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1694/3285] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:20.560219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:20.560837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:20.567522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.567969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.568736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.569924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.702497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:20.711441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a2357f3-90ac-4a44-85a5-1c79566c265f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154970 Jun 15 10:54:20.712071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1592/3286] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:20.783829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:20.784437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:20.791445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.791862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.792611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:20.793065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:20.925914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:20.935695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1f8a290c-a0f5-4728-85b6-43e65fdf8bb8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155630 Jun 15 10:54:20.936330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1695/3287] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:21.570303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:21.570896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:21.577464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.577906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:21.578666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.579099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:21.642617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:21.652299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:21.653796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:21.654923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9d15fa5-c8f6-4337-91f7-96c6d8ef98e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089297 Jun 15 10:54:21.655481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1593/3288] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:21.730292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:21.730877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:21.737467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.737907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:21.738656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.739086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:21.880219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:21.889843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e163d629-7adf-4fa9-97d4-5d82736fbc6a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165005 Jun 15 10:54:21.890424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1696/3289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:21.952758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:21.953392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:21.959381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.959906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:21.961349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:21.961789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:22.094633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:22.103135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dbf37d81-4523-4b45-b498-10432f0a3979 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154172 Jun 15 10:54:22.103699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1594/3290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:22.673584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:22.674195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:22.680557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:22.681036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:22.681809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:22.682245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:22.751319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:22.761026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:22.762505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:22.763837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e16bd4d-e7bf-4250-ac60-48f03b9df38e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094088 Jun 15 10:54:22.764383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1697/3291] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:22.907984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:22.908685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:22.915147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:22.921282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:22.921282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:22.921282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:23.048249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:23.056349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9e5794e-d5c5-4d81-b115-ac7efc7f48af tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152446 Jun 15 10:54:23.056884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1595/3292] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:23.120801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:23.121432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:23.127554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:23.127985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:23.128731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:23.129183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:23.260177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:23.269058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-35b0f9cb-e445-4d1f-8367-e9edf645832d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152556 Jun 15 10:54:23.269630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1698/3293] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:23.783094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:23.785066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:23.789865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:23.790309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:23.791104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:23.791531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:23.854073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:23.862678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:23.864234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:23.865411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad3a58ec-c60c-4add-964a-f2c269f3c504 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086285 Jun 15 10:54:23.865965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1596/3294] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:24.075132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:24.075673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:24.082209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.082653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.083439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.083865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.213281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:24.221604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e84b933-a0c5-41c0-90a9-02ef8d6249fc tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151389 Jun 15 10:54:24.222177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1699/3295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:24.286079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:24.286661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:24.293721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.294166 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.294931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.295363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.426472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:24.434641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8104fdb8-1669-4801-8b72-9dfd7974c44d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152478 Jun 15 10:54:24.435200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1597/3296] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:24.884330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:24.884929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:24.891126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.891572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.892328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:24.892764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:24.956524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:24.965839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:24.967324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:24.968495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e837e01-a5eb-4e0b-8546-94ef570a82b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088072 Jun 15 10:54:24.969072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1700/3297] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:25.239641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:25.240247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:25.246973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.247414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:25.248164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.248597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:25.381383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:25.390411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0372b40-c72c-44b2-abd3-ed43056bdb71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154811 Jun 15 10:54:25.390989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1598/3298] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:25 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:25.453143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:25.453784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:25.460317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.460761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:25.461548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.461979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:25.596685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:25.605444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48df4fe3-1c78-49cd-9af7-f9fca64ddffa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156119 Jun 15 10:54:25.606013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1701/3299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:25.987634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:25.988272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:25.994431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.994960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:25.995719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:25.996142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:26.056323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:26.064952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:26.066439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:26.067605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c413b77-b3a7-429c-9c65-513c86d55bda tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.083874 Jun 15 10:54:26.068148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1599/3300] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:26.407882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:26.408415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:26.414500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:26.414946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:26.415700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:26.416781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:26.547251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:26.557852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:26.557852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4c9f4245-9d8b-460c-916f-88af57885645 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151577 Jun 15 10:54:26.557852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1702/3301] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:26.622727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:26.623468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:26.625769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=80 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:26.630550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:26.630999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:26.631755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:26.632215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:26.763681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:26.771736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf1ed322-da09-421f-a91a-dc04aa3e737d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152901 Jun 15 10:54:26.772295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1600/3302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:27.086445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:27.086969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:27.094096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.094539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.095282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.095709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.161270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:27.170255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:27.171748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:27.172906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7495b3f2-e32a-4894-9d34-1284535cd569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090551 Jun 15 10:54:27.173491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1703/3303] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:27.573687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:27.574300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:27.580415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.580863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.581732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.582158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.710693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:27.719933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e89690d-e789-4551-a71d-c2dfa149970a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150239 Jun 15 10:54:27.720495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1601/3304] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:27.789894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:27.790486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:27.797609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.798049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.798803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:27.799235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:27.929223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:27.937590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c70bc65e-7638-4ed7-944c-75e3a9fcd1b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151546 Jun 15 10:54:27.938156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1704/3305] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:28.191374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:28.191978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:28.199401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.199869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:28.200662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.201111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:28.266028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:28.274553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:28.276676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:28.277849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d1c5f33-1368-48a2-ab9d-98bb3f17be27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090372 Jun 15 10:54:28.278401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1602/3306] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:28.737715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:28.738318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:28.745551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.746351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:28.747106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.747536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:28.877445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:28.886562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-742159dd-816a-4cdc-8f1b-8f75238ed339 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152624 Jun 15 10:54:28.887127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1705/3307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:28.954973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:28.955597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:28.962143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.962585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:28.963922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:28.964351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:29.094497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:29.102661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7cb812ed-4b28-46ea-9dc4-e706b9192216 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151509 Jun 15 10:54:29.103720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1603/3308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:29.296524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:29.297168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:29.303749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:29.307286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:29.307286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:29.307286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:29.370974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:29.379980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:29.381502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:29.382685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6ce471e-9068-41a9-a23f-5f5b9df32d3a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090241 Jun 15 10:54:29.383281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1706/3309] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:29.903886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:29.904497 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:29.910717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:29.911164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:29.911929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:29.912360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:30.041785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:30.050203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee1bc8c4-9a87-4798-99bb-88323b095246 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150286 Jun 15 10:54:30.050773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1604/3310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:30.121346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:30.121950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:30.124245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=82 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:30.128975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:30.129430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:30.130186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:30.130615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:30.262385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:30.270602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-913638fb-b34a-44a6-9f7f-db0c069cf532 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153632 Jun 15 10:54:30.271167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1707/3311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:30.401793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:30.402404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:30.408474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:30.408915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:30.409746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:30.410176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:30.474989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:30.484017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:30.485526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:30.486651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f0e307da-9277-41ee-ae92-55c61b04d194 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089312 Jun 15 10:54:30.487210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1605/3312] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:30.801242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:54:30.801536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:54:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:54:31.068413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:31.068933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:31.075749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.076197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.076953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.077412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.206245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:31.215440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f2201bf-6a8a-4a19-9096-fdf4c4496f3a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150965 Jun 15 10:54:31.216008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1708/3313] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:31 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:31.289489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:31.290093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:31.297708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.298156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.298908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.299336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.303296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:31.429348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:31.438770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-978574c6-cc52-4078-b221-835c76839813 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153008 Jun 15 10:54:31.439329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1606/3314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:31.504874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:31.505527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:31.511935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.512381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.513224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:31.513645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:31.578868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:31.587294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:31.589691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:31.590838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e523996-db2a-4883-b62c-d03643d60eeb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089850 Jun 15 10:54:31.591392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1709/3315] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:32.231636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:32.232276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:32.238511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.238960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.239717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.240147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.370941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:32.378875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-07adc37f-0540-4e17-8132-1130486cd05e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151067 Jun 15 10:54:32.379424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1607/3316] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:32 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:32.455874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:32.456480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:32.463575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.464014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.465045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.465477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.598186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:32.607055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8083dadd-dccc-47f2-8b12-9cb1e9f75462 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154873 Jun 15 10:54:32.607616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1710/3317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:32.608643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:32.609352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:32.615755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.616205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.617228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:32.617668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:32.683205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:32.691702 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:32.693207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:32.694333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4bc70192-dfed-4120-be19-226b1d824b29 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090067 Jun 15 10:54:32.694889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1608/3318] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:33.397457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:33.398064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:33.405347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.405787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.410636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.410636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.539172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:33.548846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-32e45415-b770-4ae3-9d2e-9b3be43a1973 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154735 Jun 15 10:54:33.549075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1711/3319] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:33.625947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:33.626591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:33.633350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.634322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.634611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.635038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.711918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:33.712606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:33.719624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.720074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.720843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:33.721306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:33.771037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:33.780043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-10b08c2d-c234-4d88-817f-0c6cf5d42b40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158140 Jun 15 10:54:33.780751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1609/3320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:33.788177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:33.797926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:33.799406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:33.800581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b26dd679-f7aa-4fe5-ad1b-a26fd4b5ef56 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092792 Jun 15 10:54:33.801167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1712/3321] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:34.566784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:34.567393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:34.574283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.574727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.575487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.575917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.703920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:34.712017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce8c1672-fdc7-40bf-8a20-234af1938cd5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149228 Jun 15 10:54:34.712563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1610/3322] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:34.798203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:34.798761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:34.805413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.805857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.806613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.807208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.817758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:34.818367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:34.825104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.825562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.826335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:34.826771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:34.894666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:34.903416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:34.904888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:34.906064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-75e70061-3028-47f7-9cc6-da1d1b041f63 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092073 Jun 15 10:54:34.906618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1611/3323] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:34.948286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:34.956638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6a0595a-c986-4bcd-8205-637641068694 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162293 Jun 15 10:54:34.957236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1713/3324] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:35.729108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:35.730366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:35.737077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.737554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.738303 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.738735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.872712 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:35.881209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42f68a27-2034-4d84-9e84-8dce8140718e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155871 Jun 15 10:54:35.881767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1612/3325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:35.924557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:35.925278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:35.931819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.932254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.933679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.934104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.974429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:35.975144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:35.982659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.983138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.984073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:35.984483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:35.999446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:36.008917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:36.010465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:36.011805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6a6356b-77c5-4547-b901-7de633c79690 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091118 Jun 15 10:54:36.012360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1714/3326] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:36.112680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:36.121690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c44b0d6-f5d8-4324-9716-39b31c191fab tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151143 Jun 15 10:54:36.122246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1613/3327] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:37.011273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:37.011877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:37.018628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.019064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.019807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.020235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.159238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:37.167199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f39bdbe8-b02e-4cc6-b32d-4b838193694b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.272547 Jun 15 10:54:37.168006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1715/3328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:37.172754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:37.173291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:37.173405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:37.173737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:37.179944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.180180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.180391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.180560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.181179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.181305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:37.181610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.181788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:37.255112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:37.264775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:37.266357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:37.267555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec85c693-1856-468d-9ed6-93019457242a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.241643 Jun 15 10:54:37.268316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1614/3329] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:37.321151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:37.330227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a1ccec8f-f0a9-4ce3-98c3-0ab2d383a1a4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161317 Jun 15 10:54:37.330795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1716/3330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:38.184708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:38.185472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:38.192615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.193103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.193871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.194306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.287786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:38.288388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:38.295440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.295887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.296664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.297140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.325134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:38.334287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-da76f870-e13c-4bcd-87f5-7e6cbb5d8693 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153314 Jun 15 10:54:38.334941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1615/3331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:38 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:38.347888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:38.348503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:38.354748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.355188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.355955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:38.356392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:38.361081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:38.369825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:38.371305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:38.372440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f26688f4-8e04-468b-8066-da213b115d25 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088685 Jun 15 10:54:38.373061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1717/3332] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:38.486489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:38.494528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-703277db-edf0-415d-8b1f-366eaa2cf7b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150772 Jun 15 10:54:38.495086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1616/3333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:39.352208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:39.352817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:39.359506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.360021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.360772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.361226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.391956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:39.392581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:39.399482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.399923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.400679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.401151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.469637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:39.478300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:39.479775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:39.480949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4a58f4e5-6353-43aa-b43c-ec4bcec6bdf9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093846 Jun 15 10:54:39.481532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1617/3334] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:39.504086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:39.512781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bdc6fd8f-63f2-475a-9660-9f69e2e008a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164378 Jun 15 10:54:39.513071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:39.513399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1718/3335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:39.513663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:39.520679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.521163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.521930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:39.522398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:39.657087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:39.665114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-15461643-1e4c-4bdc-8f2b-4c0e0ced64e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156014 Jun 15 10:54:39.665669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1618/3336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:40.500335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:40.500930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:40.507516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.507962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.508717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.509184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.527320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:40.534395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:40.535007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:40.541495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.541947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.543007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.543119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.572613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:40.582662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:40.584130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:40.585276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-971a85b8-424e-4da3-86a8-5a40598237be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088925 Jun 15 10:54:40.585843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1719/3337] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:40.675806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:40.681849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:40.682571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:40.683875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc3f230f-32df-44c9-8be4-261ab1d42152 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156780 Jun 15 10:54:40.684539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1619/3338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:40.688584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.689070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.689841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:40.690282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:40.821534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:40.832346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dacf281c-fd6e-4401-91df-65209238df65 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154249 Jun 15 10:54:40.833360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1720/3339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:41.603594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:41.604198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:41.611226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.611669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.612417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.612843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.682040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:41.691380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:41.692808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:41.693967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d098abfb-0807-4644-bc1a-69591ba1d786 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094284 Jun 15 10:54:41.694528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1620/3340] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:41.701803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:41.702444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:41.709481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.709896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.710656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.711080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.846516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:41.851096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:41.851759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:41.855092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-03a231da-f781-47ea-918c-595d2db179d9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157057 Jun 15 10:54:41.855667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1721/3341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:41.857984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.858425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.860458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:41.860903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:41.994447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:42.002632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0470faa6-78cd-421b-8757-977bed38d3e9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155353 Jun 15 10:54:42.003196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1621/3342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:42.712015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:42.712621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:42.719935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:42.720382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:42.721187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:42.721655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:42.784814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:42.793454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:42.794856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:42.795977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22462bd6-24e9-437f-80a4-6daf31061142 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087868 Jun 15 10:54:42.796540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1722/3343] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:42.873058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:42.873927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:42.881387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:42.881826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:42.882589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:42.883021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:43.015525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:43.019724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:43.020079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:43.020690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:43.024717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fe04737b-40ae-4d5f-9bfb-16d0159b2a99 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155706 Jun 15 10:54:43.025510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1622/3344] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:43.026827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:43.027274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:43.028036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:43.028538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:43.161569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:43.169690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6fefe32-0043-43c8-ba29-f51a4ce4d3e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153851 Jun 15 10:54:43.170251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1723/3345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:43.814639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:43.815471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:43.824567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:43.825073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:43.825870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:43.826312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:43.893942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:43.902902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:43.904994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:43.906335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b7448d16-6bc2-4fc6-ab4c-c430a2b92ae4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095484 Jun 15 10:54:43.906662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1623/3346] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:44.042842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:44.043432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:44.050007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.050451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.051196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.051630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.185800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:44.186259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:44.186880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:44.191487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be63557a-9bc9-40be-9434-0ede51013ea2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152410 Jun 15 10:54:44.192068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1724/3347] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:44.195352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.195871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.196792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.197337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.331871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:44.340123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4ec0fb96-3065-4b8f-ada4-4e07da5b63cc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157556 Jun 15 10:54:44.340688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1624/3348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:44.925328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:44.925850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:44.932037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.932484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.933286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:44.933715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:44.994058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:45.002640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:45.004129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:45.005281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b92c1349-8fec-40fe-aebe-ae50ab56bd6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.084539 Jun 15 10:54:45.005839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1725/3349] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:45.208245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:45.208851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:45.215857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:45.216293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:45.217102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:45.217821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:45.352125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:45.357788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:45.358391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:45.360316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-857053c7-6ee7-4d01-8252-ca985408d09a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156401 Jun 15 10:54:45.361774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1625/3350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:45 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:45.366493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:45.366934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:45.367686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:45.368112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:45.501864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:45.509812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e7dc593-efa7-4808-acde-648ac496e36c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155798 Jun 15 10:54:45.510381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1726/3351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:46.024090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:46.024699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:46.031030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.031473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.032225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.032657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.096733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:46.105447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:46.106922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:46.108058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4bfb2f2a-26c9-4e40-bc1e-2e6260f4f6e6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087902 Jun 15 10:54:46.108627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1626/3352] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:46.379129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:46.379129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:46.385799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.386313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.387025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.387509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.521894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:46.527364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:46.527981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:46.530953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f76ba76-c886-40ba-ba3a-75e16e450ea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156516 Jun 15 10:54:46.531520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1727/3353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:46.535448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.535899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.536674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:46.537138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:46.674007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:46.682643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9028a3dc-a140-4e6c-b968-737e4245eb94 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159031 Jun 15 10:54:46.683243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1627/3354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:47.125662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:47.126269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:47.133414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.134168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.134663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.135098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.199918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:47.209294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:47.210880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:47.212071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f7fafc7e-6546-42e8-8202-b4af3703d464 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090302 Jun 15 10:54:47.212628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1728/3355] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:47.549884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:47.551414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:47.557245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.557682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.558435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.558863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.699909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:47.700516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:47.700776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:47.707224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.707659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.708415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:47.708841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:47.709138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2657ae93-1d3b-4857-8c11-34d8a1defe8e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164040 Jun 15 10:54:47.709747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1628/3356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:47.848598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:47.856586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a43058af-a989-4f4c-b6f5-ec686fccf5a3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160733 Jun 15 10:54:47.857171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1729/3357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:48.231450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:48.232711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:48.240672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.241164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:48.241937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.242373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:48.310648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:48.320246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:48.321864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:48.322995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fbe0bf5e-6756-4cb3-b965-7ef0e08c6c91 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095579 Jun 15 10:54:48.323578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1629/3358] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:48.727229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:48.727819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:48.734291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.734730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:48.735470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.736624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:48.865774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:48.873993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fc0c0e7c-77c0-4a1d-836f-1df0d2620452 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150497 Jun 15 10:54:48.874557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1730/3359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:48.875089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:48.875811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:48.882376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.882818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:48.883608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:48.884042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:49.012281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:49.021018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1344cae0-5a39-459c-bf70-9271ed6d5abb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149980 Jun 15 10:54:49.021587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1630/3360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:49.341866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:49.342461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:49.349143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:49.349580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:49.350330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:49.350839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:49.412146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:49.420615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:49.422123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:49.423346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d58f597d-7a10-43c3-9196-66b7e4e3e4c6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085498 Jun 15 10:54:49.424413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1731/3361] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:49.891659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:49.892936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:49.899418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:49.899862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:49.900616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:49.901081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:50.035267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:50.038371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:50.038984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:50.043474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7575a26e-13f5-48f0-bfb6-50271be1741d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155632 Jun 15 10:54:50.044039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1631/3362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:49 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:50.045510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:50.045956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:50.046719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:50.047151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:50.182813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:50.191655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-848c3868-d07e-47c1-b0fa-99b15797846a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157008 Jun 15 10:54:50.192229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1732/3363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:50.441801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:50.442353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:50.448367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:50.448807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:50.449581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:50.450011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:50.514015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:50.523359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:50.524831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:50.526112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c75a7945-2977-4ad0-a838-8748d5d05f87 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088180 Jun 15 10:54:50.526665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1632/3364] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:51.061917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:51.062525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:51.069523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.069974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.070741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.071177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.202507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:51.210308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:51.211077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:51.212551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a13a82d1-b613-4eba-8d73-28b090ee9dd1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154469 Jun 15 10:54:51.213175 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1733/3365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:51.218148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.221397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.221397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.221397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.350116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:51.358108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7cce29fd-dcd3-4361-b040-db5b9feacbfd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151634 Jun 15 10:54:51.358668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1633/3366] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:51.544387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:51.545018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:51.551311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.551754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.552511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:51.552937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:51.613686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:51.621962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:51.623436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:51.624560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73278e54-02cd-4b32-9be2-90ac9714a590 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.084043 Jun 15 10:54:51.625160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1734/3367] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:52.230946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:52.231567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:52.238285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.238726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.239483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.239919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.372793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:52.375167 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:52.375785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:52.381311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-08b17425-e2c6-4770-98ab-5c2d13937aec tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154198 Jun 15 10:54:52.381885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1634/3368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:52.382513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.382957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.384017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.384451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.517469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:52.525473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-89153fba-f608-455f-ba31-9a63f9e86c5a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154121 Jun 15 10:54:52.526051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1735/3369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:52.643529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:52.644126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:52.650152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.650591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.651343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:52.651768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:52.715741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:52.725172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:52.726668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:52.727801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc2202b5-8736-4ffe-ba37-c0f9ca63e0d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088654 Jun 15 10:54:52.728345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1635/3370] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:53.399651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:53.400255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:53.406850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.407292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.409311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.409867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.413812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:53.540548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:53.543485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:53.544126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:53.549642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f8fba949-9199-468c-8614-20dfedf66eb5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153764 Jun 15 10:54:53.559735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1736/3371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:53.559926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.559926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.559926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.559926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.686111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:53.695180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a4c4b65-ddfe-4290-99c0-db522422fe46 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155713 Jun 15 10:54:53.698686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1636/3372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:53.745762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:53.746358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:53.753438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.753907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.754691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:53.755051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:53.819834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:53.828851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:53.831006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:53.832180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f131a3a0-69c2-42fd-b568-9a6e5b00c25b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090254 Jun 15 10:54:53.832732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1737/3373] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:54.568089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:54.568692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:54.575170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.575610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.576398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.576828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.703462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:54.712164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b586c7fa-3f23-4531-b864-8858a7c88bd2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148749 Jun 15 10:54:54.712736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1637/3374] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:54.713599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:54.714262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:54.721447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.721887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.722644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.723072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.850623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:54.851226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:54.851522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:54.857436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.857877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.858630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:54.859055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:54.859445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c3073b1-8a4b-47f7-aa79-add1eadf35c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149779 Jun 15 10:54:54.860014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1738/3375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:54.924214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:54.932270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:54.933761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:54.935050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19c30ae1-6e1c-470f-9c16-358fad72f32d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088365 Jun 15 10:54:54.935629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1638/3376] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:55.729658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:55.730274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:55.737263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.737712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:55.738469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.738953 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:55.869888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:55.877138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:55.877757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:55.879233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-937f72ab-9d92-4fd7-92fd-83e01f5db396 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153258 Jun 15 10:54:55.879811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1739/3377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:55.884398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.884845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:55.885647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.886082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:55.904983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:55.953657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:55.954903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:55.961140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.961585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:55.962352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:55.962785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:56.020174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:56.028833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f1af7b0d-b551-427f-b649-8c1505c19867 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155497 Jun 15 10:54:56.029671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1639/3378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:55 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:56.031007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:56.041841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:56.043308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:56.044427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae89e205-ecc2-4269-a52a-e682053f7561 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094833 Jun 15 10:54:56.044980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1740/3379] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:56.897363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:56.897911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:56.900253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=80 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:54:56.905139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:56.905592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:56.906421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:56.906874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:57.036988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:57.045104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-073e346a-1008-4d68-90da-ce77e0741c18 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152331 Jun 15 10:54:57.045668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1640/3380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:57.046702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:57.047302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:57.054542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:57.054984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:57.055732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:57.056166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:57.062373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:57.062981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:57.069641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:57.070090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:57.070849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:57.071293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:57.138646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:57.147918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:57.149360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:57.150502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c86db20-0097-49a2-9de6-faf3f51648d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091925 Jun 15 10:54:57.151058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1641/3381] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:57.188058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:57.196827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-22e4bc94-cb0e-4d68-ad80-943765d2ab22 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153800 Jun 15 10:54:57.197411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1741/3382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:54:58.062982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:58.063627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:58.071015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.071462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.072219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.072652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.169127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:58.169884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:58.178675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.179123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.179893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.180321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.204521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:58.214254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f0e32db-ae72-4cfe-880c-b98a3fda741b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155064 Jun 15 10:54:58.215096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1642/3383] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:58.219578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:58.220820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:58.227233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.227695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.228466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:58.228907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:58.246185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:58.256424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:58.262440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:58.262440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-323d3d47-712b-4ee2-9597-815ad59d0a7b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094163 Jun 15 10:54:58.262440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1742/3384] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:54:58.361900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:58.369773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c3b495b-ede1-404e-ab62-f88e01a4f9a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153741 Jun 15 10:54:58.370328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1643/3385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:59.233048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:59.233655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:59.240442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.240879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.241663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.242094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.277727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:59.280198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:59.285744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.286228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.286995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.287462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.355246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:59.365075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:59.366572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:59.367709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9ef25b2d-a357-459e-8b22-449582a6aa17 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093915 Jun 15 10:54:59.368262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1644/3386] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:54:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:54:59.386627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:59.386856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:54:59.387522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:54:59.393851 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.394292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.395088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:54:59.395350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-635a217f-6860-44fb-90b4-001a2f7cf6bf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.166089 Jun 15 10:54:59.395515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:54:59.395940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1743/3387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:54:59.524193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:54:59.532248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d0d5f30-d2f2-463b-82f3-e65ee4e23bf8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149310 Jun 15 10:54:59.532820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1645/3388] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:54:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:00.386723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:00.387343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:00.389677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=74 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:00.395094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.395539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.396292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.396724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.413831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:00.414455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:00.421018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.421466 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.422241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.422650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.459700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:00.468732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:00.470255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:00.471632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddced43c-5fd9-4ac5-92c6-e892f36484e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088785 Jun 15 10:55:00.472192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1744/3389] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:00.549921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:00.550524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:00.554681 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:00.556587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.557063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.557830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:00.558260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:00.562929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ed0c988-b187-4268-b71c-cb0517d41d74 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152960 Jun 15 10:55:00.563582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1646/3390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:00.685842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:00.693758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c86157d3-7973-42ae-bac8-8315f2fc74ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.148284 Jun 15 10:55:00.694318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1745/3391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:01.489297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:01.489905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:01.496361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.496803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.497623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.498038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.562338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:01.571565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:01.573066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:01.574200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ccf4cb4a-0840-430b-9174-2f974af62508 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088895 Jun 15 10:55:01.574763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1647/3392] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:01.579626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:01.580546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:01.587210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.587655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.588415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.588849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.710897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:01.711731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:01.718164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.718613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.719375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:01.719815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:01.724180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:01.732212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f6ae946-e856-4cd9-ad71-b956ac37b187 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156444 Jun 15 10:55:01.732781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1746/3393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:01.848902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:01.857004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9fa53e50-3e60-42f4-9a9a-b5a6b573c153 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149850 Jun 15 10:55:01.857566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1648/3394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:02.592085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:02.592680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:02.599720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.600164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.600931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.601352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.662910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:02.671467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:02.672971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:02.674112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b2cb4ffe-6ebd-4f39-a8c5-0f1a77e46e28 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086176 Jun 15 10:55:02.674672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1747/3395] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:02.749989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:02.750609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:02.757448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.757935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.758701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.759335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.875162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:02.875774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:02.883002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.883452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.884226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:02.884688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:02.891256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:02.899344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ccfceb84-790b-4d5a-9df0-5820e9bf3176 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153268 Jun 15 10:55:02.899912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1649/3396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:03.011943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:03.020603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-046e23ca-6649-49c3-8ad6-1349184866d2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149272 Jun 15 10:55:03.021189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1748/3397] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:02 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:03.693364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:03.693986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:03.700255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:03.700760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:03.701465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:03.701896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:03.766978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:03.775477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:03.776934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:03.778069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ceaf5853-465c-4736-9cbe-15aaa9cf8c3e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089427 Jun 15 10:55:03.778620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1650/3398] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:03.916656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:03.917329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:03.924297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:03.925480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:03.926329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:03.926769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:04.038073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:04.038815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:04.044854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:04.045344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:04.046097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:04.046525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:04.059260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:04.068799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4971794d-9302-44f9-a554-176ddc2dbe87 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155933 Jun 15 10:55:04.069418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1749/3399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:03 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:04.437731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:04.446299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-403bffa3-6f9c-4b81-b3b9-8d63e434b87a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.412537 Jun 15 10:55:04.446863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1651/3400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:04.795960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:04.796562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:04.803742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:04.804183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:04.804979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:04.805403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:04.867054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:04.875718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:04.877224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:04.879075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79640972-cee4-4b1d-abee-69a17c72a870 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087031 Jun 15 10:55:04.879786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1750/3401] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:05.085776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:05.086386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:05.093276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.093866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.094473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.094904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.229236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:05.237964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b018774-a5d4-4f2f-9d96-191b12bc84ac tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155440 Jun 15 10:55:05.238534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1652/3402] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:05.463616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:05.464217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:05.471182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.472716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.473005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.473438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.603898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:05.611903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5f1ef6b2-33dd-4447-a360-a2e4f0f7d294 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152140 Jun 15 10:55:05.612563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1751/3403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:05.897995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:05.898595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:05.904581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.905055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.905805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:05.906236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:05.969699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:05.978549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:05.980130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:05.981293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-365d9dd3-6f18-4fc8-b4d0-09d630e668c7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088181 Jun 15 10:55:05.981846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1653/3404] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:06.255151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:06.255887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:06.262472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:06.262965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:06.263727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:06.264166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:06.395987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:06.399429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:06.404518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-792618bf-b57f-4231-a8f2-a76e78781ba9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153988 Jun 15 10:55:06.408872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1752/3405] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:06.629672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:06.630372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:06.636921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:06.637390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:06.638136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:06.638563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:06.766718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:06.775159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7aa22a8e-aa60-496b-a5d9-d12ac5288c80 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149407 Jun 15 10:55:06.775723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1654/3406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:06.999688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:07.000280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:07.008443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.008898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.009668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.010092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.071716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:07.080089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:07.081601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:07.082721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cb681219-a104-4710-98c0-0819adc5b754 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086943 Jun 15 10:55:07.083267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1753/3407] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:07.425379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:07.425907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:07.433467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.433905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.434658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.435083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.566115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:07.574510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa88f242-1267-410b-9b20-567b41eec9b7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153355 Jun 15 10:55:07.575083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1655/3408] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:07.792951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:07.793579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:07.799651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.800095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.800844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:07.801483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:07.932315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:07.940258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ce425c81-4513-4841-900e-2a562ca713e2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151106 Jun 15 10:55:07.940817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1754/3409] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:08.102066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:08.102610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:08.109553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.109998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:08.110750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.111181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:08.115449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:08.173048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:08.181695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:08.183167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:08.184300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7eaf83e-5e1c-42a7-8e79-a50d9c13eabd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086470 Jun 15 10:55:08.184852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1656/3410] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:08.592092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:08.592693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:08.599832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.600280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:08.601118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.601583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:08.734571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:08.745980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-231d2dd7-9f5e-4476-a988-b818a7feba63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157953 Jun 15 10:55:08.746581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1755/3411] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:08.958971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:08.959586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:08.965970 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.966406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:08.967156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:08.967586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:09.096224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:09.105117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ceeba05e-74b3-4afa-a9d6-e47908e94939 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150700 Jun 15 10:55:09.105745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1657/3412] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:09.201971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:09.202599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:09.209348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:09.209726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:09.210471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:09.210896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:09.277513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:09.280873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:09.282375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:09.283545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b1bf733-9a58-4448-be9c-901073c0286f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085586 Jun 15 10:55:09.284101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1756/3413] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:09.763751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:09.764360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:09.771178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:09.771620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:09.772387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:09.772822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:09.905286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:09.914149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-023b5754-26d8-4946-8c85-32fb3a0b1830 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154124 Jun 15 10:55:09.914723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1658/3414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:09 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:10.122326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:10.122914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:10.130483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.131023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:10.131784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.132212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:10.265405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:10.275062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7979428f-9224-49b6-aaac-d4c0347447a8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156691 Jun 15 10:55:10.279216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1757/3415] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:10.301375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:10.302381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:10.308147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.308593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:10.309387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.309823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:10.370966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:10.380635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:10.382081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:10.383213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d834715-3c20-48bb-a89d-f9c8329684f6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085923 Jun 15 10:55:10.383763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1659/3416] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:10.931788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:10.932392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:10.938602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.939045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:10.939796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:10.940224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:11.067816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:11.075839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b3a210f2-0229-49f7-b983-247149c1d713 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.147889 Jun 15 10:55:11.076399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1758/3417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:10 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:11.294642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:11.295274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:11.301969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:11.302630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:11.303200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:11.303654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:11.401480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:11.402260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:11.408983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:11.409514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:11.410380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:11.411649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:11.437738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:11.445980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f37ace6-0bfa-4e1a-a50c-87211a673a02 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155303 Jun 15 10:55:11.446552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1660/3418] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:11.476213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:11.484736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:11.486296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:11.487415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0573e218-ef1d-47f7-8771-df2a8596e8f7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089953 Jun 15 10:55:11.487979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1759/3419] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:12.093648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:12.094280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:12.100340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.100777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.101568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.101999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.233438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:12.242450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a92df297-2c3b-4eb2-b649-827952143b07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153096 Jun 15 10:55:12.243042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1661/3420] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:12 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:12.463696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:12.464301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:12.470835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.471275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.472026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.472456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.505623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:12.506915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:12.513864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.514367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.515085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:12.515518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:12.588452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:12.598457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:12.600402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:12.601740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-67d245ef-16c3-42d6-93ef-3478dd00e58b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.100003 Jun 15 10:55:12.602684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1662/3421] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:12.615119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:12.623655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27003316-e702-4b03-b0ca-d1aa6fc0ac3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163697 Jun 15 10:55:12.624410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1760/3422] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:13.260246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:13.260858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:13.266998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.267446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.268206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.268644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.402311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:13.410312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-019a8d9d-2810-40e6-8595-f7016c724d2a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153933 Jun 15 10:55:13.410881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1663/3423] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:13.620219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:13.620782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:13.627189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.627633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.628386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.628882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.641115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:13.641741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:13.648412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.648863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.649650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:13.650084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:13.697295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:13.706314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:13.707855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:13.709143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70f5864b-e074-4e4d-a424-cc9b0c64e6ab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092899 Jun 15 10:55:13.709704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1761/3424] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:13.782273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:13.790909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e530c0ac-cf12-4c33-87b3-80204b80993d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153581 Jun 15 10:55:13.791487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1664/3425] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:14.427153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:14.427757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:14.434124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.434598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.435376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.435837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.564794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:14.573308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ba84c9e-d734-4b74-acf5-d86614c18a63 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150166 Jun 15 10:55:14.573876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1762/3426] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:14.728502 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:14.729145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:14.735718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.736161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.736923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.737378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.800010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:14.808333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:14.808941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:14.809343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:14.810823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:14.811978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1cb098ed-9fc2-4d45-acb9-ef64fa0a17fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087427 Jun 15 10:55:14.812682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1665/3427] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:14.815086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.815600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.816287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:14.816726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:14.948655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:14.956629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9e364de9-11ad-4146-8eaf-72a776630077 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152156 Jun 15 10:55:14.957745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1763/3428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:15.590811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:15.591424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:15.597524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.598564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:15.599343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.599795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:15.733358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:15.742209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d3f47e9-8b6e-4188-ade9-9d66c37f1b97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155504 Jun 15 10:55:15.742770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1666/3429] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:15.830189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:15.830777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:15.838387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.838827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:15.839829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.840284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:15.901350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:15.909808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:15.912105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:15.913277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a3603360-6e44-4bc4-be8f-5532538f9f35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086957 Jun 15 10:55:15.913841 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1764/3430] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:15.975236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:15.975838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:15.982159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.982538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:15.983290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:15.983717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:16.112560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:16.120521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cadc52f7-737f-49a9-b2df-fbc5653487e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149723 Jun 15 10:55:16.121105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1667/3431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:16.760268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:16.760875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:16.767047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:16.767489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:16.768240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:16.768671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:16.899720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:16.907729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bc7dc1b3-f161-4794-a166-0250878f90a6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151251 Jun 15 10:55:16.908296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1765/3432] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:16 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:16.931920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:16.932519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:16.939265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:16.939711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:16.940458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:16.940887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:17.003061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:17.012113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:17.013544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:17.014720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cd7a3fbb-10a1-4fc2-bb66-8d219c33b8d3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086673 Jun 15 10:55:17.015272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1668/3433] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:17.138371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:17.140124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:17.145868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:17.146309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:17.147064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:17.147493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:17.491864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:17.500196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a7249a9-d723-4e02-b058-3cabc33e692f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.365600 Jun 15 10:55:17.500764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1766/3434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:17.925646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:17.926413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:17.933260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:17.933822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:17.934484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:17.934916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:18.032907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:18.033654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:18.041020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:18.041551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:18.042410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:18.042835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:18.068356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:18.076646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-625ab5fd-d2ec-4a86-91fe-bacb51f8b724 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154813 Jun 15 10:55:18.077239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1669/3435] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:17 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:18.104725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:18.113339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:18.114942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:18.116072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-74566a80-76d8-4209-9b70-989dc04f96ce tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087102 Jun 15 10:55:18.116622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1767/3436] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:18.520686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:18.521253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:18.527573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:18.528027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:18.528801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:18.529265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:18.658635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:18.667056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4acaf316-3444-4ad7-bebe-78aaf09f2f2b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152449 Jun 15 10:55:18.667631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1670/3437] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:19.095484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:19.096089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:19.103166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.103604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.104349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.104778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.134302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:19.134906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:19.141664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.142112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.142885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.143317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.207203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:19.216459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:19.218013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:19.219172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cbde736d-96bb-4657-9222-4ed4e7621875 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089292 Jun 15 10:55:19.224162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1671/3438] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:19.242766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:19.251073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3660c35-6e42-4503-a09d-fcf2fb163265 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159372 Jun 15 10:55:19.251668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1768/3439] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:19.684367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:19.685027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:19.691019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.691462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.692223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:19.692652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:19.825307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:19.828728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:19.834226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9039c416-776b-4065-8185-2069f1901aee tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153603 Jun 15 10:55:19.834790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1672/3440] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:20.240871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:20.241498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:20.248013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.248457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.249238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.249675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.268503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:20.268764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:20.269246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:20.276170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.280562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.280562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.280562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.312063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:20.321378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:20.322862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:20.324009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62776a10-02fa-4a43-8d84-1bbb940762e5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087717 Jun 15 10:55:20.324567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1769/3441] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:20.412443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:20.420431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a1ac6a68-889a-4655-a6ed-e8ec9ff462c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156351 Jun 15 10:55:20.421008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1673/3442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:20.852026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:20.852561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:20.858702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.859151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.859909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:20.860345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:20.985490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:20.995092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d2831069-e3a7-4a55-a76e-8ab464425d45 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.147213 Jun 15 10:55:20.995661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1770/3443] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:21.342822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:21.343423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:21.351108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:21.351552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:21.352305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:21.352735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:21.414888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:21.423347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:21.424809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:21.427054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f4eab30-62c0-4169-a956-5aa97e91bce5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087386 Jun 15 10:55:21.427609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1674/3444] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:21.438015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:21.438614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:21.446153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:21.446597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:21.447360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:21.447793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:21.583683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:21.592026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-345ea704-3200-4578-9b33-919c87b857cd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157807 Jun 15 10:55:21.592582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1771/3445] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:22.013697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:22.014389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:22.022178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.022627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.023391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.023822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.182050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:22.190734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2d7dd79b-127b-4336-a569-c03ae83f6d32 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.181146 Jun 15 10:55:22.191974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1675/3446] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:22 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:22.445070 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:22.445636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:22.452358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.452801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.454404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.454404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.518230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:22.527502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:22.529008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:22.530172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7e173c2c-6b37-4479-8f6f-1863d1a026b1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089804 Jun 15 10:55:22.530723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1772/3447] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:22.617030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:22.617667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:22.624728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.625327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.626414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:22.627565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:22.761917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:22.770162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c214cd18-dfae-423e-a889-2323bdf70fcd tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163821 Jun 15 10:55:22.770751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1676/3448] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:23.211419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:23.212034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:23.218562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.219007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.219777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.220241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.353221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:23.361252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ad634467-f7b6-4a6e-8fa9-18622cec06a9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154185 Jun 15 10:55:23.361823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1773/3449] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:23.547721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:23.548338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:23.555471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.556003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.556723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.557188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.628608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:23.639622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:23.641118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:23.646478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-457d5cf8-a96d-4a07-b6d0-7f473e88e4b9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.098559 Jun 15 10:55:23.646478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1677/3450] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:23.789171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:23.789751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:23.796326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.796805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.798111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:23.798547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:23.941151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:23.950111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56d7e4d9-c20e-47ba-80cc-56212390c2a9 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165936 Jun 15 10:55:23.950682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1774/3451] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:23 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:24.379442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:24.380052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:24.386185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.386629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:24.387383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.387925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:24.522340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:24.530494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1acd803c-efb0-4649-9421-a33800e97877 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154978 Jun 15 10:55:24.531059 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1678/3452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:24.662308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:24.662918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:24.668930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.669404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:24.670179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.670606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:24.735028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:24.743826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:24.745325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:24.746458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3619bab2-9a97-4f14-968c-f95b473361d0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088862 Jun 15 10:55:24.747004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1775/3453] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:24.968079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:24.968682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:24.975672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.976120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:24.976890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:24.977347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:25.108068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:25.118016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fec7dea8-848c-4531-83df-801acf6b2a96 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154137 Jun 15 10:55:25.118601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1679/3454] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:25.547862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:25.548463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:25.555633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:25.556066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:25.556824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:25.557273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:25.690168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:25.699150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8feae40f-d31a-4802-95a4-6d29f7cc1387 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155211 Jun 15 10:55:25.699724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1776/3455] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:25.765735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:25.766265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:25.773751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:25.774200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:25.774981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:25.775411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:25.841951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:25.854600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:25.856090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:25.857245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c15e1d5-0612-46e0-822c-2c531e081693 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095688 Jun 15 10:55:25.857801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1680/3456] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:26.135490 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:26.136042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:26.142130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.142570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.143325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.143751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.277730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:26.286372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ad4f01c-f4f5-484b-bcc0-e0b695c9e23e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154811 Jun 15 10:55:26.286948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1777/3457] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:26.715899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:26.716536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:26.723524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.724081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.724855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.725320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.862145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:26.870923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad79ae1d-d252-4d29-8d83-f590d55abd70 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159027 Jun 15 10:55:26.871532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1681/3458] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:26.875624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:26.876234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:26.883514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.883962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.884728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:26.885190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:26.946966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:26.955480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:26.956982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:26.958667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ebc6f446-eea5-41f4-81ed-6a67c7c0ecb7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086920 Jun 15 10:55:26.959221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1778/3459] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:27.304593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:27.305250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:27.307265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=84 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:27.312169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.312623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:27.313434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.313870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:27.448613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:27.457080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a5650a30-2bee-46a6-9b28-8962129e701f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157016 Jun 15 10:55:27.457662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1682/3460] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:27.889586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:27.890199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:27.897529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.897977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:27.898754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.899190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:27.977631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:27.978212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:27.984523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.984984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:27.985758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:27.986291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:28.033901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:28.043231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c9bb3206-9d91-4a2a-83a1-f06040673887 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157443 Jun 15 10:55:28.043811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1779/3461] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:28.053161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:28.061647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:28.063148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:28.064275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-080a3364-a133-48b4-8582-0eb5d75343b8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091541 Jun 15 10:55:28.064821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1683/3462] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:28.475500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:28.476108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:28.482263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:28.482708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:28.483470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:28.483896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:28.620903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:28.629488 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-944da446-d3e5-44c9-a519-4bfbba9ffa37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158250 Jun 15 10:55:28.630090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1780/3463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:29.061755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:29.062486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:29.069451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.069912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.070668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.071102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.083180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:29.083790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:29.090663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.091111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.091878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.092314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.155781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:29.164539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:29.166055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:29.167193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9b1265ce-6611-4833-bd7b-886e85e6ae27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088524 Jun 15 10:55:29.167755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1781/3464] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:29.202992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:29.211834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2791323-98e4-4320-83d7-f77d257a482d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154063 Jun 15 10:55:29.212417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1684/3465] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:29.646654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:29.647194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:29.653499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.653947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.654721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:29.655154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:29.796860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:29.806378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-200f26d4-d4dc-4214-9c89-2915a2bb370f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163809 Jun 15 10:55:29.806985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1782/3466] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:30.185406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:30.186023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:30.193087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.193544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.194351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.194792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.230127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:30.230791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:30.239055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.239508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.240380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.240822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.258350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:30.267099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:30.268731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:30.271412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ae2cf34-5812-4351-8ec4-e39aef0016d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089037 Jun 15 10:55:30.273692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1685/3467] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:30.374691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:30.383564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-728a879d-954e-4d73-bd61-744b93bf23db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157225 Jun 15 10:55:30.384133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1783/3468] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:30.824213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:30.824754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:30.831338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.831776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.832581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:30.833031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:30.970569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:30.978731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13624d23-272b-415c-8eba-5c7886f8ac9c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158512 Jun 15 10:55:30.979297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1686/3469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:30 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:31.289905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:31.290517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:31.292789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=80 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:31.297597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:31.298057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:31.298800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:31.299233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:31.372912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:31.382375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:31.383848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:31.385101 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e6ae7278-dc32-488c-b62d-5dad760fab64 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.099060 Jun 15 10:55:31.385575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1784/3470] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:31.403639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:31.404251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:31.411662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:31.412112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:31.412878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:31.413343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:31.547985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:31.556805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f86de348-1cbd-4e2c-976e-4600a7e9fd5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156992 Jun 15 10:55:31.557448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1687/3471] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:31.996045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:31.996684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:32.002862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.003304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.004730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.005573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.139137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:32.148237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-13dffd96-3317-4bdb-8da5-e2438c6cf61e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155940 Jun 15 10:55:32.148820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1785/3472] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:31 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:32.403234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:32.403899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:32.410291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.410816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.411655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.412085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.477528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:32.486593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:32.488071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:32.489753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-32e3ae5c-7194-468f-b19f-80a9f0c15b09 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090575 Jun 15 10:55:32.490337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1688/3473] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:32.574435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:32.575043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:32.582627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.583067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.583828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:32.584260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:32.588382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:32.718986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:32.728849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3006d64f-977a-413a-8520-2a1303655c34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158170 Jun 15 10:55:32.729469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1786/3474] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:33.166596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:33.167205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:33.173549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.173994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.174744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.175173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.200006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:33.325886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:33.334571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc45af93-6e5c-4b2c-9d74-eb2b32192ed3 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.171916 Jun 15 10:55:33.335165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1689/3475] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:33.508818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:33.509556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:33.515776 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.516315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.517213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.517639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.585325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:33.594621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:33.596148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:33.597440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cb193a07-d6b0-4f62-af0e-de8d3c816992 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093027 Jun 15 10:55:33.597952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1787/3476] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:33.746514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:33.747122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:33.754461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.761438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.761438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:33.761438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:33.895871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:33.906012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-96c60c34-99e8-4023-8381-49b92b6b96ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163497 Jun 15 10:55:33.915368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1690/3477] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:34.353102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:34.353710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:34.359809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.360242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:34.361016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.361447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:34.508445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:34.513326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-53837551-2ec3-476e-96db-a6c6311ef0f4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164189 Jun 15 10:55:34.513891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1788/3478] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:34.614870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:34.615384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:34.622962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.623425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:34.624200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.624607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:34.686362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:34.695724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:34.697279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:34.698426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09db625f-6aee-4bf3-9dee-2c21f948cf8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087522 Jun 15 10:55:34.698999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1691/3479] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:34.923877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:34.924437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:34.930934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.931370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:34.932386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:34.932731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:35.066630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:35.077822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3eb87927-d229-4e58-8979-62b9d85a073c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157879 Jun 15 10:55:35.078402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1789/3480] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:35.530824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:35.531442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:35.538293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:35.538735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:35.539491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:35.539918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:35.681654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:35.691052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c5bbf25-4550-4dd7-a16e-2eb43a234bff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164046 Jun 15 10:55:35.691623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1692/3481] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:35.717409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:35.718018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:35.725932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:35.726313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:35.727078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:35.727515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:35.801985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:35.812038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:35.813543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:35.814657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-def69cec-8440-4802-a8c0-3cc8d25acc7c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.101442 Jun 15 10:55:35.815206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1790/3482] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:36.095848 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:36.096373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:36.102614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.103052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.104349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.105118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.240563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:36.249337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-13194f99-6066-43ff-b3b7-6299a9f85662 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157544 Jun 15 10:55:36.250040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1693/3483] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:36.708923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:36.709593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:36.717410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.717854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.718612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.719045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.834719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:36.835327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:36.843282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.843726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.844501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:36.844998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:36.862109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:36.870657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ba6ecd92-25d6-4ab7-b7b8-aca97b39e751 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165572 Jun 15 10:55:36.871345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1791/3484] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:36.912090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:36.921327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:36.922826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:36.923959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df422266-a45b-44fd-bdd9-554508d987e1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093194 Jun 15 10:55:36.924533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1694/3485] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:37.268671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:37.269325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:37.275708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.276169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:37.276951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.277414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:37.417897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:37.427423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d6e6e11f-2163-4f87-817a-46cb67340a19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163226 Jun 15 10:55:37.427998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1792/3486] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:37.891744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:37.892386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:37.899299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.899789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:37.900545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.901004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:37.942282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:37.942877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:37.953125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.953572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:37.954340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:37.954771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:38.040385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:38.040385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:38.040687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:38.040687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5a106184-27a9-4cdb-90a8-51e98d49696a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.098788 Jun 15 10:55:38.040687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1793/3487] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:38.049896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:38.058136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f5baac5d-4da3-4b45-9f73-5ab70aec62df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.171593 Jun 15 10:55:38.058707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1695/3488] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:37 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:38.445810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:38.446558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:38.454215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:38.454656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:38.455658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:38.456088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:38.594392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:38.603209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2e0592ae-5d0d-4427-ac59-21c43841cdff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161241 Jun 15 10:55:38.603772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1794/3489] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:39.056881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:39.057556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:39.065224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.065667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.066434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.066863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.075894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:39.076496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:39.083231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.083683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.084452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.084889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.133225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:39.144619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:39.146199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:39.147357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-455b244b-565b-43ed-8584-be9ed8cbab7a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094786 Jun 15 10:55:39.147913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1696/3490] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:39 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:39.226777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:39.236732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be2e5786-16cd-40d4-bd3b-c706b582e0ce tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164947 Jun 15 10:55:39.237343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1795/3491] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:39.619686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:39.620296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:39.627753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.628197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.628990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:39.629501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:39.767822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:39.776471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e4b42908-ecba-43fb-bb1f-669d10ddb850 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160599 Jun 15 10:55:39.777070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1697/3492] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:40.165625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:40.166177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:40.173432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.173874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.174620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.175072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.242233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:40.254526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:40.255215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:40.256007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:40.256192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:40.257232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-06a14964-2982-4581-8826-7bd1d648e52f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095529 Jun 15 10:55:40.258000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1796/3493] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:40.264440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.264793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.265558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.265998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.404427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:40.412629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b46aadb-4bf5-41dd-a7e4-32bca0088585 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161783 Jun 15 10:55:40.414186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1698/3494] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:40.794859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:40.795384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:40.801882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.802516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.804128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:40.804565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:40.943735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:40.953392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c1dc9a25-684e-4fba-a7cc-886cfd13852f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163303 Jun 15 10:55:40.953958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1797/3495] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:41.275719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:41.276924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:41.285288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.285726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:41.286496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.286926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:41.352360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:41.362332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:41.363804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:41.365389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ad8d89a-e26d-4922-a251-c14f9f6d1891 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093472 Jun 15 10:55:41.365952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1699/3496] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:41.432601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:41.433274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:41.440409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.442182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:41.443157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.443712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:41.582951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:41.591779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-07a4fe7f-0014-42b5-ba38-d52c9f4a00ca tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163064 Jun 15 10:55:41.592354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1798/3497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:41.971993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:41.972598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:41.978717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.979162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:41.979989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:41.980472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:42.119018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:42.127575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97d0b7b2-7f71-41a9-9b7f-a2aa54c2f9bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159326 Jun 15 10:55:42.128144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1700/3498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:42.387130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:42.387748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:42.394193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:42.394637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:42.395429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:42.395862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:42.467382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:42.476220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:42.477736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:42.478886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23d5e56e-4f20-457b-8fdc-3b92f4fb3c67 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.096789 Jun 15 10:55:42.479433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1799/3499] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:42.608891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:42.609513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:42.616370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:42.616819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:42.617614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:42.618050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:42.761362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:42.769954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c234320b-2dde-48a0-9725-3621d4c1228f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165508 Jun 15 10:55:42.770525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1701/3500] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:43.147477 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:43.148077 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:43.155283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.155720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.156467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.156899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.292514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:43.301573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-db20dcd4-f452-428c-b502-0f3b40f3fa05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157964 Jun 15 10:55:43.302141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1800/3501] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:43.498071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:43.504938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:43.506532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.507015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.507783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.508221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.574614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:43.582837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:43.584315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:43.585515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-175b3ab7-d785-44c9-9110-4814b18e65f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091812 Jun 15 10:55:43.586066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1702/3502] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:43.788224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:43.789177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:43.796563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.797029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.797784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:43.798220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:43.939261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:43.950115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a7ee132-4f12-4eb5-ae82-320be4ea0853 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165400 Jun 15 10:55:43.951634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1801/3503] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:43 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:44.319767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:44.320381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:44.328175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.328618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:44.329405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.329892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:44.468152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:44.476314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d324aa02-9d5c-460c-ba30-007e2a9d359c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160536 Jun 15 10:55:44.476883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1703/3504] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:44.604619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:44.605302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:44.611489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.611929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:44.612680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.613138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:44.677995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:44.681379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:44.689088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:44.690707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:44.692194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8729192-80ec-4251-8506-51d131199b36 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091565 Jun 15 10:55:44.692778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1802/3505] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:44.970104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:44.970716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:44.977118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.977559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:44.978309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:44.978739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:45.122613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:45.130715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1d41069b-c918-4f55-828d-e447636155c0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165219 Jun 15 10:55:45.131289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1704/3506] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:45.494262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:45.494866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:45.502128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:45.502572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:45.503349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:45.503742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:45.639516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:45.649787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1700a1f6-5c5c-4092-aa0a-fc7ee07a3207 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.159694 Jun 15 10:55:45.650824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1803/3507] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:45.712946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:45.713659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:45.721790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:45.722317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:45.723094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:45.723530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:45.791553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:45.802749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:45.804229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:45.805411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8b2208df-4e01-4c71-bcbb-00fa22b44dc5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.097568 Jun 15 10:55:45.805966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1705/3508] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:46.147999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:46.148663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:46.155150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.155593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.156364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.156826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.293850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:46.302021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-10d6f7c4-f091-4ea0-af32-a6053fb2b500 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157886 Jun 15 10:55:46.302588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1804/3509] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:46.667748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:46.668532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:46.675690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.676139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.676921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.677385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.682028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:46.821652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:46.824041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:46.824694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:46.832014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.832456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.832871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-03cba9eb-aca5-47f5-9865-fd76e40550bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.168566 Jun 15 10:55:46.833589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:46.834033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:46.834173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1706/3510] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:46.903731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:46.912491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:46.913987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:46.915125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6b3e8c56-a846-4404-91ce-d5428504880a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095011 Jun 15 10:55:46.915675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1805/3511] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:47.319741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:47.320361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:47.327282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.327766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:47.328523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.328980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:47.468346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:47.476533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82d41dbe-3d0e-4af4-a6bb-c08763bb9e23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160633 Jun 15 10:55:47.477132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1707/3512] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:47.853273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:47.853830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:47.861858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.862436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:47.863342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.863876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:47.937796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:47.940438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:47.945287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.945732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:47.946534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:47.946987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:48.005624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:48.012367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:48.014542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-94e6e466-4331-44cd-b8f9-6b008c5b0ade tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165425 Jun 15 10:55:48.015121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1806/3513] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:48.021710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:48.023214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:48.024341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-18a857a9-4d21-40ae-8242-777c4d4906d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092017 Jun 15 10:55:48.024883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1708/3514] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:48.493483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:48.494089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:48.500277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:48.500717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:48.501495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:48.501927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:48.632064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:48.640881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-afb582b4-86ba-4b5d-ba80-77d438420b95 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151473 Jun 15 10:55:48.641476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1807/3515] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:49.032252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:49.033007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:49.039463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.039911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.040674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.041134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.043530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:49.044398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:49.053400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.053853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.054795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.055336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.127301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:49.136416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:49.138486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:49.139778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3905822-e699-4b2f-9dcd-f385b431ba24 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.101129 Jun 15 10:55:49.147075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1808/3516] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:49.188789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:49.197588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f5c7681-2ac0-4686-8071-5d512de0e390 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.169013 Jun 15 10:55:49.198084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1709/3517] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:49 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:49.658355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:49.658883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:49.665107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.665555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.666315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:49.666747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:49.804299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:49.812623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a0a06a3d-171f-4e47-aa39-8521f4749b52 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158217 Jun 15 10:55:49.813216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1809/3518] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:49 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:50.158286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:50.158932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:50.165551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.166000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.166770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.167203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.218527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:50.219122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:50.225904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.226341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.227129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.227560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.230889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:50.240134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:50.241820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:50.242838 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db2147a1-1634-44dd-9a4c-42fa7812c510 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088529 Jun 15 10:55:50.243393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1710/3519] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:50 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:50.368750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:50.377218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f50aff7-9029-4344-b5fb-310d647338cf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164160 Jun 15 10:55:50.377979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1810/3520] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:50.830435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:50.830960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:50.837092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.837574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.838333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:50.838877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:50.974805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:50.985069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99e4ddec-00ca-4931-a91b-a57696a85055 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158429 Jun 15 10:55:50.985722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1711/3521] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:50 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:51.262440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:51.263111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:51.271081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:51.271650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:51.272478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:51.272910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:51.337552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:51.347986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:51.349622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:51.350773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-558397d5-2e59-4f4a-885c-4f79518a9bf3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092396 Jun 15 10:55:51.351380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1811/3522] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:51.400144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:51.400850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:51.408811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:51.409282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:51.410045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:51.410591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:51.551884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:51.560010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3f6129c-52a9-47ad-8844-b844343a4ff9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163604 Jun 15 10:55:51.560559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1712/3523] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:52.003141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:52.003742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:52.010098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.010531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.011411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.011836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.142428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:52.151094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cfacbb27-48cb-4596-b869-f4cb5c2290df tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151688 Jun 15 10:55:52.151656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1812/3524] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:52.369752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:52.370278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:52.377876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.378315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.379071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.379499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.450171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:52.458947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:52.460434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:52.461621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-57c1fbd9-daf0-4dfc-9665-60d5f344fae6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095829 Jun 15 10:55:52.462188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1713/3525] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:52.577231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:52.577835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:52.584575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.585052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.585824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:52.586267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:52.724190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:52.733238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4039e423-0a4a-44e7-b23f-4c43adf3b7bd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160047 Jun 15 10:55:52.733808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1813/3526] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:53.169000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:53.169652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:53.176425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.176867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.177655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.178084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.315409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:53.324262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d212c24c-471e-4754-9a08-b7cfa578dcfb tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159226 Jun 15 10:55:53.325140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1714/3527] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:53.479798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:53.480440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:53.488055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.488491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.489280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.489708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.556295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:53.568121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:53.569860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:53.571844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d21bbcb7-d524-4604-987a-5a1a4d0d5316 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095713 Jun 15 10:55:53.572831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1814/3528] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:53.751284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:53.751823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:53.758500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.764064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.764064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:53.764064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:53.892069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:53.900056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-eb43cde4-8015-47b7-8070-394a78fb3791 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152807 Jun 15 10:55:53.900615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1715/3529] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:54.342962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:54.343565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:54.350209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.350685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:54.351445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.351903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:54.486282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:54.495612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a579c17c-77a6-4d47-ab43-4ce5cca9634e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157312 Jun 15 10:55:54.496163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1815/3530] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:54.591457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:54.592086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:54.598413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.598792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:54.599543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.599973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:54.663928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:54.672556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:54.674056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:54.675185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7844e81a-d158-4d62-9019-48edab2e04f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088806 Jun 15 10:55:54.675737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1716/3531] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:54.917978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:54.918545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:54.924606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.925089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:54.925845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:54.926288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:55.056207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:55.064613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c8833c28-adc9-4da2-b065-fbde4de0ec6c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150552 Jun 15 10:55:55.065207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1816/3532] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:55.515794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:55.516403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:55.522604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:55.523052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:55.523812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:55.524243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:55.663018 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:55.672129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-89dcb25d-b323-4fdf-9627-4eb05e01b135 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160956 Jun 15 10:55:55.672732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1717/3533] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:55.697495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:55.698137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:55.705613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:55.706064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:55.706860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:55.707294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:55.773262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:55.782558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:55.784033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:55.785207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f9892a29-b429-4721-9073-9a9ede8cfe1f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093530 Jun 15 10:55:55.785762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1817/3534] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:56.082033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:56.082556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:56.088651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.089136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.090137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.091139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.226191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:56.234942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d25f8a76-ad72-40c6-beed-5294a69a0eef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156841 Jun 15 10:55:56.235510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1718/3535] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:56.690506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:56.691107 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:56.697504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.697949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.698706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.699139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.803893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:56.804431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:56.811807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.812250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.813174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:56.813617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:56.833630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:56.842489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8b5ee4cb-5b1d-45dc-b081-17e708754014 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155112 Jun 15 10:55:56.843266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1818/3536] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:56.877865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:56.886464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:56.887954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:56.889365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8453b01-8b35-467d-b9d9-7410e554c80a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089591 Jun 15 10:55:56.889935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1719/3537] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:57.260003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:57.260612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:57.267930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.268381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.269219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.269653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.291428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:57.409871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:57.418240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-766169a2-914a-417c-be77-3ba21df11ab1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162010 Jun 15 10:55:57.418848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1819/3538] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:57.859962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:57.860532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:57.862921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=76 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:57.867915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.868373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.869203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.869637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.907945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:57.908563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:57.918290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.918733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.919512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:57.919967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:57.988424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:57.996928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:57.998415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:57.999785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9129ff2b-41ff-428a-8432-4e70a2b226a6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.096405 Jun 15 10:55:58.000337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1820/3539] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:55:58.011173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:58.019484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce166b93-6544-4d32-b4c6-d5da1224fb07 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163539 Jun 15 10:55:58.020045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1720/3540] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:57 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:55:58.436240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:58.436784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:58.443346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:58.443791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:58.444571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:58.445028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:58.580193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:58.588770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddf6e7fb-1819-4561-9bf4-046636f0d3b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156471 Jun 15 10:55:58.589696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1821/3541] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:59.017920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:59.018567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:59.025084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.025532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.026291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.026726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.036145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:59.036754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:59.044039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.044480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.045282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.046203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.089336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:59.098308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:59.099837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:59.100996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1879b89-08a6-42e9-bc9a-71ea8c627b97 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087014 Jun 15 10:55:59.101554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1721/3542] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:55:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:55:59.180984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:59.189592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-528afa9c-5784-4343-ad80-1f79d7d51aba tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157299 Jun 15 10:55:59.190164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1822/3543] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:55:59.607679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:55:59.608289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:55:59.615084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.615533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.616298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:55:59.616736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:55:59.747616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:55:59.751558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:55:59.756350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e914e856-07df-4632-b461-05ee3f624864 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152520 Jun 15 10:55:59.756915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1722/3544] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:55:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:00.119944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:00.120541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:00.128946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.129416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.130215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.130649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.197342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:00.207708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:00.208357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:00.210575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:00.212112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:00.213366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-75c89a94-4dcc-4aa9-955e-bbfc83154413 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.097228 Jun 15 10:56:00.213920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1823/3545] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:00.216326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.216776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.217597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.218073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.362212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:00.370676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc953a74-508e-4388-82bf-8a9ad2516f54 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.166947 Jun 15 10:56:00.371177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1723/3546] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:00.773458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:00.774095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:00.780408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.781589 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.782202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:00.782634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:00.914655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:00.930135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28eaaa50-5dfd-42ee-ba7f-fed9edd55fa2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160368 Jun 15 10:56:00.930712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1824/3547] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:01.234439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:01.235745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:01.242906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.243346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:01.244111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.244542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:01.309652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:01.319162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:01.320794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:01.321974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-699a4618-ac83-4518-a84a-2fa7fafaa8b6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092312 Jun 15 10:56:01.322530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1724/3548] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:01 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:01.387862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:01.388466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:01.391127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=82 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:01.396143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.396591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:01.397447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.397884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:01.533182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:01.541454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6666c919-c2e4-4774-ac23-4b5d37e0013f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157430 Jun 15 10:56:01.542041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1825/3549] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:01.947869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:01.948385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:01.955149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.955677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:01.956426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:01.956856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:02.093635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:02.101897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1a9ff245-dfd0-4ec5-8a5b-61e212c1d878 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.157970 Jun 15 10:56:02.102452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1725/3550] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:02.340988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:02.341601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:02.348139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:02.348581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:02.349370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:02.349800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:02.414370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:02.423138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:02.424603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:02.425764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e296153f-6b6a-48f1-9d6b-17ac90e21560 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089134 Jun 15 10:56:02.426324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1826/3551] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:02.560052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:02.560676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:02.568665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:02.569143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:02.569913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:02.570335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:02.701207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:02.709909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7907e328-65af-47c9-b6ca-8d318893ee39 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154052 Jun 15 10:56:02.710491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1726/3552] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:03.119499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:03.120100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:03.126921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.127366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.128133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.128557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.270897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:03.279846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d312aef4-71b3-45fd-89e5-fb3a8651b7b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.164156 Jun 15 10:56:03.280444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1827/3553] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:03.443967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:03.444491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:03.450946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.451387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.452153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.452624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.519649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:03.528775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:03.530280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:03.531852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c8356d1-f31d-4fdc-89df-1cb111335a1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091725 Jun 15 10:56:03.532416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1727/3554] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:03.727833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:03.728458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:03.736153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.736564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.737396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:03.737993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:03.881646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:03.890654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-621597f7-87c2-427f-93c6-1c7bc11ce469 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.166381 Jun 15 10:56:03.891365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1828/3555] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:03 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:04.298010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:04.298769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:04.305598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.306046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:04.306819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.307258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:04.471955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:04.480651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-02817369-5f31-4dc9-a2f1-a5fcdadd1ab8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.187216 Jun 15 10:56:04.481282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1728/3556] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:04.552362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:04.553230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:04.560000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.560437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:04.561264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.562266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:04.635498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:04.646253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:04.647976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:04.649526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-07cb8529-16c8-4321-bd76-7ecac3267b33 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.101441 Jun 15 10:56:04.650328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1829/3557] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:04.909020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:04.909552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:04.915958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.916411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:04.917222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:04.917659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:05.065276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:05.072266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36bb9b08-d5ef-4ad8-a4e8-22b3dee174e2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.167726 Jun 15 10:56:05.072880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1729/3558] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:04 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:05.502777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:05.503499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:05.512832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:05.513620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:05.515665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:05.516613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:05.669234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:05.669881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:05.677185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:05.677634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:05.678408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:05.678844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:05.711446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:05.727068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1ed4ec3-f0b6-453e-bad0-289e7f11aa4e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.230652 Jun 15 10:56:05.728068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1830/3559] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:05.759257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:05.776228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:05.779288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:05.780984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9c60d948-272a-4a0a-aa6d-f8883d14b73c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.115732 Jun 15 10:56:05.781628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1730/3560] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:06.091316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:06.091865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:06.098718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.099153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.099910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.100505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.232110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:06.241647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dfa1167f-5c7e-4c82-bb0d-39a575443929 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154525 Jun 15 10:56:06.242219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1831/3561] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:06.752275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:06.752879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:06.759812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.760261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.761082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.761517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.800038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:06.800633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:06.808594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.809072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.809854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:06.810288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:06.881252 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:06.890939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:06.898160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:06.898160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36870a0c-d47a-4944-8695-4850d323d44d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.098235 Jun 15 10:56:06.898160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1832/3562] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:06.918968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:06.930719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2dd9fc43-3295-4144-8353-efb3ed791e2d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.182583 Jun 15 10:56:06.931496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1731/3563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:07.259164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:07.259771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:07.266596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.267035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.267798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.268286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.408837 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:07.416916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be2f30ed-8d49-4680-a937-4c3b3f089770 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161546 Jun 15 10:56:07.417512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1833/3564] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:07.914360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:07.914915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:07.922061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.922508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.923266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.923699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.951593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:07.952834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:07.959714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.960152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.960922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:07.961376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:07.986687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:07.995305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:07.996813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:07.997972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09bd2c61-96ff-4282-ba96-b55c6574145b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087595 Jun 15 10:56:07.998556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1732/3565] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:08.096170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:08.104763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a372a11a-0d51-46ee-bef1-bea2854cf1b9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156878 Jun 15 10:56:08.105373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1834/3566] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:08.434968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:08.435577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:08.442145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:08.442586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:08.443344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:08.443779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:08.577911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:08.587547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-91d283a3-ae56-42ef-a173-901d9988157e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156400 Jun 15 10:56:08.588111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1733/3567] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:09.016580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:09.017244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:09.023994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.024492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.025307 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.025742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.091682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:09.100404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:09.101938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:09.103084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9450293b-a742-4797-a40a-0def6008241c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091214 Jun 15 10:56:09.103628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1835/3568] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:09.122113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:09.122726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:09.129977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.130431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.131234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.131675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.272547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:09.281862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-16e460ac-8953-44bb-9fa2-2e7c823c54f8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.163259 Jun 15 10:56:09.282471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1734/3569] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:09 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:09.605956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:09.606932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:09.613876 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.614316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.615071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:09.615500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:09.619569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:09.749882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:09.758403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1cfdc32-44b8-4da9-875b-f91cbd72a6ab tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156429 Jun 15 10:56:09.759190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1836/3570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:09 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:10.121312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:10.121960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:10.129516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.130227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.130734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.131171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.196203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:10.206505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:10.207983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:10.209207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ed3826e0-cb85-4873-aabd-f6f23b0eb2d5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091947 Jun 15 10:56:10.209784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1735/3571] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:10.299733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:10.300332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:10.306931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.307546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.308295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.308724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.440590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:10.449286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c193fedc-d88a-4b3c-99cc-d79f48ed6f5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153737 Jun 15 10:56:10.450094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1837/3572] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:10.776674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:10.777328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:10.784261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.784669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.785457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:10.785892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:10.916805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:10.925944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9db0ba9-7146-4979-be05-32071c4ac451 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153071 Jun 15 10:56:10.926528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1736/3573] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:10 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:11.227861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:11.228460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:11.235793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.236233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:11.237016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.237445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:11.305118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:11.315561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:11.317069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:11.318182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0c9e9fd2-4316-4e2c-ae5c-94d908c12c19 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094248 Jun 15 10:56:11.318733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1838/3574] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:11 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:11.467329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:11.468464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:11.475647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.476095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:11.476861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.477476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:11.615389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:11.623501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b5cf5460-be44-4360-ad69-a89f6439587b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160469 Jun 15 10:56:11.624254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1737/3575] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:11.942688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:11.943331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:11.949560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.950002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:11.950756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:11.951187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:12.092844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:12.101250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f49f30c1-1f95-40c4-b9f3-817b5f404424 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.162365 Jun 15 10:56:12.101850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1839/3576] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:11 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:12.335875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:12.336480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:12.343528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:12.344242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:12.345042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:12.345477 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:12.408038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:12.416685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:12.418177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:12.419300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-48885714-fe8e-456f-9e3a-aa1f058580f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087376 Jun 15 10:56:12.419852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1738/3577] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:12.641773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:12.642339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:12.649096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:12.649544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:12.650313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:12.650750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:12.796288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:12.805097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f039044a-656a-4986-b6ef-1761ab137d88 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.167841 Jun 15 10:56:12.805685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1840/3578] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:13.118067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:13.118685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:13.126191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.126749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.127527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.127965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.147297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:13.266517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:13.275009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-655f9095-0cc2-4393-8055-26797e768f9b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160841 Jun 15 10:56:13.275577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1739/3579] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:13.447746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:13.448386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:13.455388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.455833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.456581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.457038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.522406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:13.532074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:13.533606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:13.534826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ea696b07-f6b0-4d91-b17d-e6eb4a989f6e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090979 Jun 15 10:56:13.535390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1841/3580] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:13.823490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:13.824066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:13.830793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.831242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.832019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:13.832456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:13.979727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:13.988723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43bab73b-8565-45bf-a118-933162b61cbc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.169226 Jun 15 10:56:13.989358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1740/3581] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:14.293338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:14.293943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:14.300251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:14.300692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:14.301485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:14.301913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:14.432819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:14.441420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9fc0c690-0b75-407f-9467-030553f3463e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151914 Jun 15 10:56:14.441990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1842/3582] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:14.552891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:14.553471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:14.559985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:14.560425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:14.561796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:14.562336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:14.623422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:14.632788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:14.634273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:14.635390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc1be693-2d24-4308-aa35-bbfaace0ba27 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086506 Jun 15 10:56:14.635950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1741/3583] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:15.007104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:15.007713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:15.013830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.014266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.016187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.016621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.148023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:15.156580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-618c3086-f3e0-40e2-9408-1e468dcf8526 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153373 Jun 15 10:56:15.157206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1843/3584] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:15 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:15.459185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:15.459807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:15.466221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.466668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.468058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.468692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.605337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:15.613816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df9a1ee8-f55c-4b82-8418-2517fa2f7c21 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158477 Jun 15 10:56:15.614372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1742/3585] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:15.653864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:15.654474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:15.661993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.662436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.663194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:15.663626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:15.729371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:15.738148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:15.739665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:15.740804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c448b414-bca0-4363-8c16-b9d0b0b26600 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090828 Jun 15 10:56:15.741400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1844/3586] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:16.174103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:16.174624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:16.180627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.181105 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.181856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.182338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.317695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:16.325565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b253cefd-2a6a-4594-a852-a7e119a05958 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155442 Jun 15 10:56:16.326129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1743/3587] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:16.631791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:16.632385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:16.640313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.640757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.641573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.642003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.758883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:16.759600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:16.766531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.766982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.767755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:16.768248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:16.772223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:16.781538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3003680-a01c-45a1-babe-e90f457b21f6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154197 Jun 15 10:56:16.782188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1845/3588] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:16 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:16.834766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:16.844764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:16.846266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:16.847430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99d7363b-c33a-440e-96fe-c4a350513dab tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092504 Jun 15 10:56:16.847983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1744/3589] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:17.343818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:17.344445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:17.350832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.351279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.352039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.352476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.483586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:17.491590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36a01116-dc63-4e6c-a751-57cec1acf78a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151865 Jun 15 10:56:17.492599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1846/3590] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:17.798602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:17.799143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:17.805627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.806125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.806820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.807248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.865160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:17.865752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:17.873479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.873985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.874780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:17.875220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:17.942972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:17.943223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:17.951313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9daf8e02-a1c4-4f0e-b617-25f0a2fb8f91 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156817 Jun 15 10:56:17.952286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:17.952798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1745/3591] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:17 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:17.954292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:17.955431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4e5f667-a89c-424a-ada2-2c89aee4fba4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094254 Jun 15 10:56:17.955967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1847/3592] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:18.509537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:18.510157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:18.516647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.517121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:18.517878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.518308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:18.646685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:18.654743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d6dcd623-ad4f-44de-b202-033f5d2a1a95 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149338 Jun 15 10:56:18.656081 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1746/3593] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:18.971316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:18.971961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:18.974792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:18.975411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:18.978921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.985011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:18.985011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.985011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:18.985447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.985447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:18.985447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:18.985447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:19.052279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:19.061217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:19.062907 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:19.064066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-299f8dc1-c641-45a9-b234-9f2002b98569 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093649 Jun 15 10:56:19.064648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1747/3594] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:19.123553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:19.132030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e0f6cc4c-ce8c-4da9-ab9f-53c3680bc3c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165694 Jun 15 10:56:19.132725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1848/3595] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:19.673297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:19.673910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:19.680296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:19.680739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:19.681530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:19.681958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:19.808842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:19.817614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42937e19-612b-4fed-96de-696ef0f7000c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.148776 Jun 15 10:56:19.818182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1748/3596] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:20.082494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:20.083056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:20.090015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.090459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.091233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.091658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.149824 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:20.150557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:20.154479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:20.156928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.157391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.158152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.158584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.163438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:20.164936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:20.166085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2c418b23-cb03-4da3-8329-ea99fe1b4156 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087620 Jun 15 10:56:20.166644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1849/3597] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:20.289893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:20.299084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64eb175f-21f3-40a8-9c68-9c48fe4ac475 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153186 Jun 15 10:56:20.300828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1749/3598] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:20.836291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:20.836853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:20.844164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.844607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.845395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:20.845830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:20.976486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:20.984571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-462f5954-d172-4348-a70f-860154cd8e57 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152181 Jun 15 10:56:20.985185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1850/3599] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:21.184158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:21.184697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:21.191973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:21.192413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:21.193211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:21.193649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:21.262020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:21.271651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:21.273150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:21.274294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b59425a0-7428-4181-b9f5-cbd9beae9ee9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094100 Jun 15 10:56:21.274859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1750/3600] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:21.316184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:21.316824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:21.323351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:21.323795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:21.324549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:21.325000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:21.454504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:21.462523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a1d9a13-4f9a-4458-a4b1-caa0ddb4c8e4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150243 Jun 15 10:56:21.463085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1851/3601] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:22.002688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:22.003293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:22.009516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.009957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.010713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.011185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.140699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:22.149033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-78422fb6-0b12-4fcf-a68b-34e6f6a5aa40 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150677 Jun 15 10:56:22.149600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1751/3602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:22.292110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:22.292648 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:22.300011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.300451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.301248 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.301763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.367297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:22.370770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:22.376579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:22.378103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:22.379245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c5fc184a-fcf7-4239-8f4e-5fd5fe58859a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091414 Jun 15 10:56:22.387325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1852/3603] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:22 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:22.480051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:22.480666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:22.487383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.487827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.488586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:22.489049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:22.618120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:22.626908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b04682f3-aab6-459b-a490-74a653e359a5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150771 Jun 15 10:56:22.627483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1752/3604] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:23.167591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:23.168168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:23.175080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.175528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.176302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.176739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.322439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:23.331947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fbaed43c-137b-4cef-8bd1-73461e0c233b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.168152 Jun 15 10:56:23.332548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1853/3605] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:23.404231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:23.405999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:23.412822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.413297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.414071 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.414499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.492992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:23.504132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:23.505642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:23.506799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5ad1e634-907e-48ec-b185-2d53a339b659 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.106885 Jun 15 10:56:23.513204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1753/3606] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:23.645453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:23.646060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:23.653209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.653657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.654424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:23.655446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:23.798951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:23.807724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-97a693ef-c3d7-45a1-afe6-c21648926da5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.167067 Jun 15 10:56:23.808615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1854/3607] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:23 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:24.351370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:24.351977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:24.358126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.358664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.359426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.359856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.492990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:24.502534 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6ed47f7f-dbc2-43e9-bb73-87c8e796fe84 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154971 Jun 15 10:56:24.503185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1754/3608] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:24.529535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:24.530187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:24.537144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.537592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.538353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.538787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.603969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:24.614059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:24.615528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:24.616683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4d368ef-37f7-4ee7-a716-4664e37be264 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091006 Jun 15 10:56:24.617272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1855/3609] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:24.825727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:24.826355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:24.832643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.833206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.833893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:24.834398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:24.982337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:24.991492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98601146-33bc-41f5-95c8-178743ce49b5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.169643 Jun 15 10:56:24.992055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1755/3610] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:24 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:25.520217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:25.520844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:25.527656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:25.528099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:25.528856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:25.529317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:25.635975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:25.636723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:25.643782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:25.644227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:25.645020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:25.645461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:25.649585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:25.667810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:25.677414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-84bf8d63-b3d4-422f-b7ae-b2fe39f6a504 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160905 Jun 15 10:56:25.677998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1856/3611] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:25.711437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:25.721198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:25.722658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:25.723793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a9100689-bc55-4138-b573-625df53910ed tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091857 Jun 15 10:56:25.724344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1756/3612] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:26.009728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:26.010364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:26.017321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.017760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.018505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.018928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.148922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:26.157555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ef2b9ba-2335-4513-a9c9-66d003db640a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151753 Jun 15 10:56:26.158121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1857/3613] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:26.695069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:26.695701 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:26.702324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.702773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.703657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.704133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.742118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:26.742721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:26.750732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.751539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.752010 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:26.752445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:26.816538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:26.825647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:26.827140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:26.828300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7a92cdf-bce6-4758-87ae-ab420d4995fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089985 Jun 15 10:56:26.828866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1858/3614] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:26.841441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:26.852037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bd84cddb-2387-4b41-96aa-98bb82c42cd1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.160644 Jun 15 10:56:26.852644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1757/3615] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:27.174339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:27.174891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:27.181331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.181779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.182543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.182977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.319973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:27.328672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-917a6cff-64b1-408d-b7cd-664dc4743daf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157763 Jun 15 10:56:27.329272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1859/3616] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:27.847546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:27.848113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:27.854954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.855402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.856168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.856608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.869571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:27.870253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:27.876803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.877280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.878047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:27.878485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:27.918837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:27.928679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:27.930289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:27.931442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fd21393-5d18-4252-a9e8-b8a8afa1edd2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088704 Jun 15 10:56:27.932002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1758/3617] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:28.007738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:28.015798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e55eab42-89ac-4cd3-8f47-c4371773e3db tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150025 Jun 15 10:56:28.016359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1860/3618] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:28.347524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:28.348145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:28.350373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=78 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:28.355651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:28.356094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:28.356890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:28.357332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:28.500773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:28.508793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b3b0488-c596-417f-acb6-54f3be608b1f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.166244 Jun 15 10:56:28.509436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1759/3619] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:28.950153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:28.950850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:28.958522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:28.958962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:28.959711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:28.960138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:29.025559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:29.034340 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:29.034983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:29.035681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:29.037176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:29.038305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c7f36f3-1da1-4ee7-a834-47ce3ba5720a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092011 Jun 15 10:56:29.038855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1861/3620] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:29.041739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:29.041992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:29.042713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:29.043144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:29.175177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:29.183239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5b08e2d5-84e4-4179-b1b2-1fff0989171b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154075 Jun 15 10:56:29.183806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1760/3621] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:29 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:29.527310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:29.527920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:29.534754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:29.535192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:29.535955 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:29.536389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:29.678535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:29.686964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7bf7631b-31b4-4627-9886-43b473d04758 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.163829 Jun 15 10:56:29.687535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1862/3622] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:30.057054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:30.057645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:30.065170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.065620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.066398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.066826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.131000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:30.139975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:30.142394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:30.143614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dfb44437-1866-4b49-b190-355f7d44f168 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090417 Jun 15 10:56:30.144175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1761/3623] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:30.200538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:30.201215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:30.209047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.209499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.210282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.210719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.343586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:30.351707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27ed45f2-7c4b-464e-9870-b1bdf99b6a6f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155050 Jun 15 10:56:30.352278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1863/3624] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:30.705132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:30.706028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:30.713368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.713368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.713953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:30.714640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:30.851213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:30.859846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-786ca852-d896-4820-bf44-379618d191aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158989 Jun 15 10:56:30.860808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1762/3625] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:30 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:31.161845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:31.162398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:31.168866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.169358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:31.170111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.170541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:31.238232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:31.247073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:31.248568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:31.249759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a634c4f-02e1-4e80-b334-41bb1d4a2051 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091923 Jun 15 10:56:31.251134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1864/3626] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:31.369190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:31.369819 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:31.377245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.378308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:31.379090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.379521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:31.513148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:31.522170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92ed36bb-e645-4304-a3c4-12e37cb11972 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156829 Jun 15 10:56:31.522757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1763/3627] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:31.878599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:31.879124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:31.881038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=80 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:31.886040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.886479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:31.887245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:31.887679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:32.031269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:32.041116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5841c938-aedb-4c1b-ab68-53847d8c56a0 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.167273 Jun 15 10:56:32.041683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1865/3628] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:31 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:32.268781 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:32.269456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:32.275937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:32.276376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:32.277187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:32.277626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:32.342744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:32.352279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:32.353914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:32.355057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b504a47-027c-4f9a-9cee-d3d46d8756d7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091082 Jun 15 10:56:32.355605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1764/3629] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:32 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:32.544275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:32.544848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:32.551560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:32.552002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:32.552766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:32.553221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:32.686274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:32.694879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e9922fed-8573-4eaa-a343-881c7cdae89f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156423 Jun 15 10:56:32.695441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1866/3630] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:33.058489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:33.059108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:33.066471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.066909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.067664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.068129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.199434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:33.207759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-08a609e7-8ba5-4f88-8058-bd1900aed8d2 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153089 Jun 15 10:56:33.208343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1765/3631] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:33.373920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:33.374421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:33.380698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.381170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.381916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.382343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.446786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:33.455935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:33.457443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:33.458567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-08cec411-40b8-4e70-ae6a-a96e4100785a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088713 Jun 15 10:56:33.459209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1867/3632] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:33.712151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:33.712757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:33.719158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.719601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.721050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:33.721746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:33.849822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:33.858168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb109342-02a9-4c07-b68a-10763b140aff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149933 Jun 15 10:56:33.858732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1766/3633] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:34.226529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:34.227134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:34.233705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.234139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.234885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.235308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.373446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:34.381371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e949f443-61ee-4050-afcc-677cae926e2e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158702 Jun 15 10:56:34.381935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1868/3634] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:34.476710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:34.477290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:34.483719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.484188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.484945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.485397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.548624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:34.557243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:34.558718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:34.559853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-397c141f-36bd-4771-be9f-044bc128a666 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087137 Jun 15 10:56:34.560413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1767/3635] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:34.877828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:34.878347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:34.884373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.884812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.885586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:34.886011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:34.904805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:35.014554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:35.023266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9090cde6-a83d-4fbb-9f57-e0ceb32aab9f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149972 Jun 15 10:56:35.023830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1869/3636] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:35.398663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:35.399275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:35.405452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:35.405895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:35.406650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:35.407077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:35.539697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:35.548033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0ad7560-d8a9-4f6f-b635-3b072e88e979 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153541 Jun 15 10:56:35.549289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1768/3637] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:35.578262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:35.578858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:35.585517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:35.585962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:35.586724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:35.587159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:35.656946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:35.666561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:35.668042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:35.669206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8758d19d-9add-4e18-8340-1c9dd82b8702 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.094812 Jun 15 10:56:35.669759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1870/3638] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:36.041352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:36.041961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:36.048010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.048587 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.049392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.049832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.180148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:36.186593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a1fd75df-db96-43cc-ad98-4d5707866e98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149207 Jun 15 10:56:36.187155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1769/3639] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:36 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:36.566349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:36.566985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:36.573160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.573610 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.574368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.574800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.687749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:36.688358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:36.695449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.695947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.696653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:36.697109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:36.708042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:36.716351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-581c82d1-9207-4738-9ecc-8dbb0df1b44a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154045 Jun 15 10:56:36.717142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1871/3640] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:36.763841 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:36.773402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:36.774869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:36.775982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0a9ded05-0631-4148-bac3-6a29361b74fc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092297 Jun 15 10:56:36.776533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1770/3641] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:37.205753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:37.206463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:37.213004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.213503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.214619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.215059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.350842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:37.359120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-983e696f-e773-450c-abf1-8fa9bb2f6f06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158179 Jun 15 10:56:37.359681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1872/3642] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:37.734027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:37.734658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:37.742732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.743175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.744111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.744543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.795007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:37.795583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:37.803048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.803495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.804271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:37.804704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:37.873668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:37.883300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:37.884875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:37.886143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3c5b01c-372c-4faa-a870-0ed3cabfb3be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095158 Jun 15 10:56:37.886807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1873/3643] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:38.121323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:38.129837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-963b9e17-1c1f-46f8-b5dc-3fa2c8789e53 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.399682 Jun 15 10:56:38.130490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1771/3644] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:37 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:38.376558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:38.377221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:38.383365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:38.383806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:38.384565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:38.385032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:38.515702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:38.523718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f3fd55b-7d1e-4354-b3ad-8a4c2499ce8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151060 Jun 15 10:56:38.524270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1874/3645] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:38.904928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:38.905603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:38.912991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:38.913440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:38.914199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:38.914634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:38.977636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:38.981029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:38.986224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:38.988182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:38.989344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c0fdba41-8a04-44d0-b7c1-3e0bb2edace6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088281 Jun 15 10:56:38.996056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1772/3646] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:39.147573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:39.148177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:39.155324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:39.155695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:39.156449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:39.156867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:39.292570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:39.301275 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ea9890df-b6d5-4e30-8597-25ab0a27cc0d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.157495 Jun 15 10:56:39.301839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1875/3647] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:39 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:39.542491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:39.542628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:39.548746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:39.549448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:39.550114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:39.550552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:39.681117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:39.689272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-85876876-f989-431e-8c6d-da7b58ba4c1a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151397 Jun 15 10:56:39.690461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1773/3648] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:39 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:40.012950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:40.013592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:40.020719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.021203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.021965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.022400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.085617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:40.094273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:40.095764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:40.096903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4fc06df-400a-4cf4-9cff-e1cff1447715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087974 Jun 15 10:56:40.097495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1876/3649] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:40 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:40.318855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:40.319723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:40.325952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.326401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.327164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.327595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.457884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:40.466104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2e9d0be4-6ceb-4a92-8782-c7db9ce34185 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151900 Jun 15 10:56:40.466672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1774/3650] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:40 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:40.707868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:40.708465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:40.715390 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.715833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.716587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:40.717048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:40.847259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:40.855353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c1d319d-856f-42a3-88d2-54129c8444df tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152147 Jun 15 10:56:40.855913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1877/3651] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:40 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:41.114999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:41.115528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:41.121963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.122409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:41.123177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.123612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:41.184102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:41.192713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:41.194225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:41.195360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82c74650-69bc-4896-9402-6fef169ef0c4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.084596 Jun 15 10:56:41.195915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1775/3652] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:41 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:41.483766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:41.484363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:41.491220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.493936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:41.493936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.493936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:41.626183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:41.634718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b93db7b4-d1b5-40af-b17d-2c47e825edef tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154834 Jun 15 10:56:41.635289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1878/3653] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:41 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:41.872979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:41.873557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:41.880298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.880754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:41.881541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:41.881975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:42.013172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:42.022274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-80e68b26-2908-4861-9177-e2639a5dab4c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153361 Jun 15 10:56:42.022844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1776/3654] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:41 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:42.213222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:42.213824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:42.220614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:42.221299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:42.222005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:42.222433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:42.288562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:42.297216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:42.298726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:42.300408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93fffbf1-c12f-41cc-b6ae-a6a0482e8fa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091111 Jun 15 10:56:42.300981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1879/3655] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:42 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:42.652590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:42.653227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:42.660054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:42.660496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:42.661290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:42.661725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:42.793670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:42.802377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-030d5662-849d-4617-bd93-40066c1cff1b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153637 Jun 15 10:56:42.802934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1777/3656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:42 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:43.040089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:43.040695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:43.046836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.047228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.047980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.048415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.176457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:43.184449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-024a5943-9e3e-4297-9ba0-b2aa1f27c575 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.148258 Jun 15 10:56:43.185034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1880/3657] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:43 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:43.318434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:43.319046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:43.325626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.326073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.326832 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.327256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.390060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:43.399920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:43.401415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:43.402549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7fd5e6a1-f8ea-4a58-8f60-a0cef55c0c53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088278 Jun 15 10:56:43.403107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1778/3658] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:43 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:43.819448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:43.820223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:43.835691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.836136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.836937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:43.837391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:43.976460 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:43.985068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-618978b1-2fdb-42b3-a41f-2b6f18d44d9a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.169476 Jun 15 10:56:43.988785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1881/3659] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:43 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:44.202118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:44.202663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:44.209139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:44.209580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:44.210331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:44.210763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:44.341903 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:44.350442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3d70879a-dfe8-4577-ac58-21876c4af5c8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152242 Jun 15 10:56:44.351008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1779/3660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:44 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:44.421389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:44.421988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:44.428893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:44.429358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:44.430104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:44.430530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:44.495638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:44.504281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:44.505794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:44.506925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0910b2d9-9c2b-45b0-b6d8-e2e28e0e5c40 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089404 Jun 15 10:56:44.507486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1882/3661] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:44 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:45.003023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:45.003627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:45.009709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.010150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.010905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.011341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.139046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:45.147207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7dabc3d9-a336-4c8b-bc02-afa65c027d4a tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148245 Jun 15 10:56:45.147776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1780/3662] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:44 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:45.368354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:45.368939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:45.375122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.375571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.376366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.376798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.510194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:45.519023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a5979643-503a-4c21-8c51-575e886a7e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154603 Jun 15 10:56:45.525240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:45.526921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:45.528678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1883/3663] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:45 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:45.535569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.536041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.536812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:45.537281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:45.602670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:45.611150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:45.612747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:45.613902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ca519bbe-63d8-4af2-9601-6fd938438a2d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092792 Jun 15 10:56:45.614463 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1781/3664] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:45 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:46.167653 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:46.168280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:46.177029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.177489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.178439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.178943 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.340330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:46.350326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae86dc57-b20b-454c-8fc7-e6982fc60bb7 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.188622 Jun 15 10:56:46.350889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1884/3665] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:46 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:46.536415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:46.537184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:46.544935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.544935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.545283 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.545739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.633783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:46.634406 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:46.642510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.643503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.644288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:46.644729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:46.688159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:46.697510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36e7d31a-6011-4f08-ae7b-b41209a51f58 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165270 Jun 15 10:56:46.698104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1782/3666] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:46 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:46.716583 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:46.725868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:46.727353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:46.728503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a992e71b-fcb0-46b1-ab1f-ecfdab8147cd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.099719 Jun 15 10:56:46.729266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1885/3667] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:46 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:47.370151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:47.370757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:47.376885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.377983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.378766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.379548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.511461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:47.520319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f8a48e50-524f-4d1e-8d7e-fad2011d76cf tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154606 Jun 15 10:56:47.520892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1783/3668] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:47 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:47.716647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:47.717310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:47.724408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.724845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.725621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.726051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.730183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:47.746634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:47.747406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:47.754597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.755034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.755787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:47.756274 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:47.827424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:47.837413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:47.838958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:47.840418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bbbbc137-459d-43e5-ac0f-854bf3881712 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.097675 Jun 15 10:56:47.841007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1784/3669] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:47 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:47.865810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:47.874227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b12c871f-e41f-42aa-99c3-ee472ea8c833 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.161713 Jun 15 10:56:47.874816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1886/3670] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:47 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:48.539501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:48.540030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:48.546612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.547049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.547803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.548227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.681682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:48.689666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-24dede59-f119-43e0-8bb4-1722172dc158 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154400 Jun 15 10:56:48.690281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1785/3671] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:48 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:48.859194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:48.859751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:48.866768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.867215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.867984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.868414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.891964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:48.893364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:48.900484 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.900933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.901726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:48.902160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:48.933206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:48.943440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:48.945075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:48.946246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79f9071c-147f-45be-923b-d35e5cb6a9f1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091081 Jun 15 10:56:48.946810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1887/3672] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:48 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:49.033833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:49.041688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40dd3e27-3e51-46f2-82e3-d3da65d9f2b4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153855 Jun 15 10:56:49.042256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1786/3673] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:49.691311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:56:49.691585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:56:49.707665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:49.708362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:49.715388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:49.715832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:49.716629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:49.717098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:49.964263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:49.965165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:49.972075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:49.973084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:49.974017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:49.974518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:50.013064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:50.021655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2475eef9-eb5e-42ad-9328-40d1b4162f6e tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.318161 Jun 15 10:56:50.022538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1888/3674] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:49 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:50.040724 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:50.049323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:50.051362 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:50.052640 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1772b723-56be-4aa9-b682-7a6767440a89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092221 Jun 15 10:56:50.053246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1787/3675] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:49 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:50.059624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:50.060231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:50.066472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:50.067066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:50.067815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:50.068276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:50.197277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:50.205315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88f1dee6-8831-4618-be6c-f15cb595c1d8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150173 Jun 15 10:56:50.205864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1889/3676] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:50 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:51.039148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:51.039760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:51.047065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.047507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.048614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.049122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.071427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:51.072037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:51.078598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.079051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.079816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.080251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.143780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:51.152658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:51.161134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:51.161134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b4e120a1-bcc2-4733-a962-8a058836109d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088648 Jun 15 10:56:51.161134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1890/3677] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:51 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:56:51.187536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:51.196537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ecdf02b6-cb1a-4353-9963-72650eb4803c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.161338 Jun 15 10:56:51.197147 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1788/3678] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:51 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:51.223869 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:51.224582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:51.230958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.231398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.232148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:51.232575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:51.577804 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:51.586353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9ede2cf9-1912-4a1e-b8c8-2f390a907800 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.366674 Jun 15 10:56:51.586907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1891/3679] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:51 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:52.173531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:52.174132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:52.180946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.181422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.182189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.182633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.203191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:52.214711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:52.219945 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:52.222083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.222930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.223296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.223757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.250161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:52.259215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:52.260805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:52.261979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-033aa62c-9cd4-4aee-9250-c16e5da49c89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092393 Jun 15 10:56:52.262537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1789/3680] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:52 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:52.355695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:52.363730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1e394aeb-a441-4b1c-b22a-ed6636e7aea5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153601 Jun 15 10:56:52.364292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1892/3681] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:52 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:56:52.605269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:52.605982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:52.612757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.613314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.614228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:52.614657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:52.748172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:52.756183 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-99f712be-1fa5-47ed-9e0e-9f8aa546c6a7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155378 Jun 15 10:56:52.756823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1790/3682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:52 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:53.279846 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:53.280450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:53.287003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.287446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.288221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.289182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.359425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:53.368644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:53.370145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:53.371271 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2fa8106c-1de8-4546-93b6-a7a98a63f713 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.095428 Jun 15 10:56:53.371819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1893/3683] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:53 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:53.382353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:53.383133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:53.389987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.390480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.391282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.391721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.524387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:53.534036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5178b908-d920-45c4-938a-67f35bf74ab6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154285 Jun 15 10:56:53.534036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1791/3684] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:53 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:53.775216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:53.775820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:53.782085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.782528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.783285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:53.783752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:53.918198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:53.926158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7134a28c-a791-45f1-aca2-0cfbc8f3e8af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155536 Jun 15 10:56:53.926707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1894/3685] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:53 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:54.389176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:54.389802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:54.396308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.396751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:54.397552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.398538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:54.458567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:54.468721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:54.470212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:54.471344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-12d0d901-0738-49ab-bbbf-626707a2c518 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086200 Jun 15 10:56:54.471899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1792/3686] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:54 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:54.550728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:54.551454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:54.560129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.560567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:54.561386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.561810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:54.692474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:54.701600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c2258c0e-490f-49f1-a393-0d855dfc6fa4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154607 Jun 15 10:56:54.702250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1895/3687] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:54 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:54.944400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:54.945443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:54.951825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.952262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:54.953049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:54.953516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:55.085685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:55.094116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25a1f3ed-682f-44ab-aa87-faa8f9e52393 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154278 Jun 15 10:56:55.094684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1793/3688] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:54 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:55.490345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:55.490973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:55.498016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:55.498462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:55.499218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:55.499647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:55.565637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:55.574430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:55.575906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:55.577063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-34631bf6-de29-4e36-875d-e91683763d37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090559 Jun 15 10:56:55.577609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1896/3689] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:55 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:55.720327 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:55.720928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:55.727882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:55.728324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:55.729116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:55.729548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:55.859239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:55.867374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-005ddf36-e4e9-4179-9938-9dfa1d724149 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150867 Jun 15 10:56:55.867950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1794/3690] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:55 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:56.111484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:56.112021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:56.119126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.119574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:56.120338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.120773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:56.250345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:56.258598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d0af2cb-6f6e-4092-9b34-86d4168e53c0 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151076 Jun 15 10:56:56.259173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1897/3691] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:56 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:56.594857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:56.595462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:56.602647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.603050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:56.603811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.604240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:56.666637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:56.675173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:56.676647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:56.677806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8fa8ab0d-a001-49c8-9275-88c94ddf0c34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086858 Jun 15 10:56:56.678380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1795/3692] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:56 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:56.885335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:56.885879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:56.892453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.892897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:56.893695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:56.894123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:57.023194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:57.032376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ca06793-68bd-4ba0-96ed-d62313da9f26 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151830 Jun 15 10:56:57.032944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1898/3693] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:56 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:57.275757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:57.276356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:57.282489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:57.282934 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:57.283698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:57.284131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:57.416905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:57.425290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7dd25dcb-fe31-44cb-b95d-4e1987cd4047 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153333 Jun 15 10:56:57.425863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1796/3694] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:57 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:57.695862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:57.696456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:57.703371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:57.703807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:57.704613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:57.705078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:57.769897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:57.778856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:57.780320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:57.781514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-72702bbf-230b-499f-9f62-da2e4d7ea242 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089563 Jun 15 10:56:57.782065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1899/3695] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:57 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:58.050233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:58.050852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:58.057655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.058191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.058943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.059377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.194330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:58.203076 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b08fa114-2568-4825-8083-0b51ccabc8f8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156808 Jun 15 10:56:58.203641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1797/3696] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:58 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:58.443700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:58.444258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:58.451279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.451713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.452462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.452900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.584605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:58.593369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cdf4a2b5-4381-4acb-ade6-d7ea537ba82a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153479 Jun 15 10:56:58.593937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1900/3697] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:58 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:58.799368 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:58.799955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:58.806033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.806480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.807221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:58.808128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:58.870855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:58.879597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:58.881107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:58.882247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-795f36f2-6ee1-4ac7-b703-fac6a3e35e93 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.086726 Jun 15 10:56:58.882806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1798/3698] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:58 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:56:59.138752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:56:59.138997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 10:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:56:59.223700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:59.224302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:59.231232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.231668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.232424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.232849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.375891 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:59.383828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f72d2a8-911b-4dd0-ae83-6a3236a7ab23 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.164001 Jun 15 10:56:59.384389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1901/3699] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:59 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:59.611251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:59.611857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:59.614391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=80 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:59.619298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.619749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.620567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.621209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.754309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:59.763020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-89c78e70-5fc5-4fb2-8cd2-1c76bde18e6b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155609 Jun 15 10:56:59.763584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1799/3700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:56:59 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:56:59.899704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:56:59.900280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:56:59.907547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.907993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.908755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:56:59.909218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:56:59.974768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:59.978153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:56:59.983591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:59.985106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:56:59.986240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90506a0f-46c1-4515-b486-860728021627 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090506 Jun 15 10:56:59.986792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1902/3701] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:56:59 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:00.402399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:00.403098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:00.409310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:00.409755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:00.410515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:00.410951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:00.542215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:00.550843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3aadeb43-d758-4559-89af-2ea9fa85c8e5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153088 Jun 15 10:57:00.551410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1800/3702] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:00 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:00.781393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:00.782009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:00.788382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:00.788860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:00.789733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:00.790256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:00.923622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:00.931733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d7cf2f23-834a-487e-b6be-0b4aa8089927 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155439 Jun 15 10:57:00.932277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1903/3703] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:00 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:01.004784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:01.005414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:01.012576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.013044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:01.013812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.014246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:01.079165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:01.087610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:01.089131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:01.091107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bbe167eb-37ec-4c4a-b4a6-301419d892e8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090193 Jun 15 10:57:01.091667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1801/3704] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:00 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:01.568481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:01.569128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:01.576194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.576640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:01.577430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.577865 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:01.709203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:01.718254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ddba8de-0e5f-4652-9842-b3606429b588 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153592 Jun 15 10:57:01.718818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1904/3705] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:01 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:01.949716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:01.950302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:01.956224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.956664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:01.957440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:01.957870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:02.091787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:02.100461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f077c597-bf45-4eae-bbb9-dd6642cb8506 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155061 Jun 15 10:57:02.101037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1802/3706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:01 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:02.109826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:02.110423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:02.112684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=80 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:02.117656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:02.118105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:02.118905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:02.119339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:02.184251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:02.192781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:02.194319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:02.195452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-50ff2e7e-b654-45f8-9237-f3c07aacc975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090690 Jun 15 10:57:02.196038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1905/3707] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:02 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:02.735998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:02.736606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:02.742697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:02.743142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:02.743909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:02.744349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:02.876144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:02.884130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4e90bc59-b043-4410-98f2-d9c8602a9e1d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152137 Jun 15 10:57:02.884686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1803/3708] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:02 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:03.118588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:03.119177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:03.125700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.126146 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:03.126905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.127336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:03.213057 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:03.213663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:03.220668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.221142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:03.221904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.222437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:03.257195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:03.266259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21b72f72-64c8-4199-acc4-fa9b6e669ac3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151552 Jun 15 10:57:03.266839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1906/3709] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:03 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:03.287765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:03.296810 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:03.298387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:03.299516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf4fc9c6-2cdf-4843-bb62-a31a909db9be tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090284 Jun 15 10:57:03.300063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1804/3710] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:03 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:03.902536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:03.903067 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:03.909286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.909745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:03.910496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:03.910927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:04.039334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:04.048276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-27c80d9b-9c97-4140-8006-d1e56c0c8a71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150185 Jun 15 10:57:04.049627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1907/3711] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:03 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:04.284390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:04.285254 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:04.291664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:04.292122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:04.293047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:04.293476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:04.317909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:04.318517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:04.326384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:04.326829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:04.327588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:04.328014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:04.394623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:04.404250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:04.405761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:04.406925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d54b9028-3ff3-4130-8fbf-6e58ee54a67e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092999 Jun 15 10:57:04.407480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1908/3712] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:04 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:04.428431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:04.436585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e918ba3-2e66-4aef-9662-5102eb38ae4a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156525 Jun 15 10:57:04.437181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1805/3713] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:04 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:05.065426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:05.066044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:05.072082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.072532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.073363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.073813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.204414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:05.212521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-88c3944a-d743-4955-a43c-064b67b00542 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151194 Jun 15 10:57:05.213112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1909/3714] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:05 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:05.425001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:05.425563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:05.432047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.432486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.433945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.434381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.438345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:05.454035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:05.454736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:05.460946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.461405 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.462155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:05.462770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:05.495591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:05.504167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:05.505709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:05.506862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddbf1593-533d-4e9e-baa7-48a36c7b89ef tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085904 Jun 15 10:57:05.507423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1806/3715] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:05 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:05.595221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:05.603193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9f333720-ad07-4459-9306-a9a85d58aedf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153352 Jun 15 10:57:05.603751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1910/3716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:05 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:06.229852 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:06.230474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:06.236618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.237106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.237865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.238296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.370696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:06.378787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bde37e11-ab51-42cb-88cc-c88c9dcfb0b4 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152838 Jun 15 10:57:06.379348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1807/3717] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:06 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:06.525387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:06.525977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:06.533496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.533938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.534695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.535121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.600235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:06.608815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:06.610302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:06.611430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ac6867d4-2abc-42cd-8631-469e4253717a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090068 Jun 15 10:57:06.611978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1911/3718] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:06 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:06.621555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:06.622170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:06.628665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.629143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.629895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:06.630323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:06.761627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:06.770079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6f42b30-c103-4304-b253-d9abc21ca191 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152816 Jun 15 10:57:06.770646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1808/3719] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:06 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:07.395363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:07.395965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:07.402041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.402480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.403238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.403660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.531484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:07.540082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-56704439-b96b-4dba-8934-a3da8fa7b620 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.148503 Jun 15 10:57:07.540638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1912/3720] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:07 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:07.629344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:07.629952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:07.636562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.637030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.637791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.638225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.698661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:07.707348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:07.708822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:07.709991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f8bd59f-6efe-4244-88be-933bb27250a5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.084532 Jun 15 10:57:07.710544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1809/3721] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:07 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:07.787574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:07.788174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:07.795047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.795504 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.796233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:07.796658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:07.925890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:07.934023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ba321abf-0e2a-4f5f-bf53-e88806440ef6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150264 Jun 15 10:57:07.934593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1913/3722] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:07 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:08.558947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:08.559595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:08.565822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.566273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:08.567043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.567481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:08.701384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:08.709295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf34920a-aaf7-4a60-abd7-0e027618658d tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154670 Jun 15 10:57:08.709871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1810/3723] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:08 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:08.727552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:08.728140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:08.735258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.735699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:08.736481 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.736916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:08.800365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:08.808829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:08.810990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:08.812133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28c603b6-f7fb-4fc8-9eb5-b720fa7cae34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088441 Jun 15 10:57:08.812683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1914/3724] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:08 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:08.951213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:08.951807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:08.957869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.958309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:08.959055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:08.959483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:09.087861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:09.097151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5be53c22-f7d5-4f7f-9be1-0b37d69ad68c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.149734 Jun 15 10:57:09.097718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1811/3725] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:08 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:09.728125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:09.728735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:09.735969 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:09.736413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:09.737192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:09.737625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:09.829694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:09.830287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:09.836886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:09.837365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:09.838126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:09.838568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:09.867055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:09.875679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5f2b070e-e3f2-4e9d-a0b6-8b4f15d9c194 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151412 Jun 15 10:57:09.876190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1915/3726] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:09 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:09.902511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:09.911423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:09.912881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:09.914025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f8a0226-268a-4b11-857f-cfe393313604 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088165 Jun 15 10:57:09.914581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1812/3727] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:09 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:10.115974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:10.116518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:10.123346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.123789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:10.124541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.124995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:10.257743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:10.266432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dc09a3f2-4c48-41f8-b817-5e0bcc24a426 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154340 Jun 15 10:57:10.267017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1916/3728] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:10 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:10.893405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:10.894097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:10.900538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.901001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:10.901754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.902180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:10.931561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:10.932165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:10.939149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.939604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:10.940366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:10.940801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:11.005732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:11.015098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:11.016573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:11.017742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4648dca0-4e95-46b9-a009-68cc6cd5cc86 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090036 Jun 15 10:57:11.018304 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1917/3729] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:11.046961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:11.054923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e474af83-8756-4116-ab9c-6658aa15e391 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.165415 Jun 15 10:57:11.055489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1813/3730] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:10 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:11.284033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:11.284672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:11.291364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:11.291801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:11.292552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:11.293002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:11.423850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:11.431722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0727674b-45f9-4154-813d-56a0f07bde30 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151497 Jun 15 10:57:11.432279 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1918/3731] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:11 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:12.036648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:12.037313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:12.044015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.045749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.046526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.046968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.072903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:12.073523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:12.080573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.081036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.081806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.082241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.101538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:12.110074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:12.118784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:12.131703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:12.131703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29ab0488-04b2-49f0-94cc-b9cb5a85692d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088764 Jun 15 10:57:12.131703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1814/3732] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:12 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:12.152214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:57:12.152519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:57:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:57:12.214187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:12.223603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4eba2534-7039-47a2-a1fc-ceb744cb56c1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.154493 Jun 15 10:57:12.224158 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1919/3733] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:12 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:12.450925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:12.451666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:12.458230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.458685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.459468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:12.459904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:12.656406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:12.664811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac43bceb-1fdc-4f5a-b74f-0c4cb700126d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.218441 Jun 15 10:57:12.665411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1815/3734] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:12 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:13.139896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:13.140514 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:13.147055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.147502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.148261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.148692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.212557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:13.221470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:13.222954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:13.224085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e4bff7ed-c6e9-40a4-95e4-5234be0f6318 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088310 Jun 15 10:57:13.224659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1920/3735] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:13 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:13.240541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:13.241198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:13.248263 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.248754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.249550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.249986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.379120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:13.387082 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d76402c-f140-4ec1-bbb3-e42e59034f97 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150336 Jun 15 10:57:13.387758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1816/3736] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:13 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:13.683286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:13.683948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:13.690540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.690978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.691761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:13.692192 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:13.835102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:13.844105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b3af2bd-e790-411a-bf04-6ed98d8dad0d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.165105 Jun 15 10:57:13.844674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1921/3737] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:13 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:14.242515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:14.243130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:14.250434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.250884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:14.251643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.252073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:14.317704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:14.326296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:14.327752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:14.328896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a3a3bd8b-ea25-461a-aa56-5a76f4f5b5fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090364 Jun 15 10:57:14.329490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1817/3738] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:14 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:14.403649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:14.404799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:14.410964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.411404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:14.412157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.412588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:14.540930 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:14.549926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d3f66eb6-c7ea-4315-a8d1-80d4a6e16c83 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.150272 Jun 15 10:57:14.550507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1922/3739] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:14 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:14.861533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:14.862060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:14.868061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.868512 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:14.869313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:14.869747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:15.001232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:15.009154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e547b2b-970c-420b-bfcb-ad1c4ac171de tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152103 Jun 15 10:57:15.009726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1818/3740] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:14 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:15.347259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:15.347886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:15.353935 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:15.354373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:15.355124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:15.355555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:15.423926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:15.429946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:15.431425 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:15.432555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae68142b-34d5-4c0d-93e3-46564777d1f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089290 Jun 15 10:57:15.433131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1923/3741] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:15 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:15.567031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:15.567717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:15.574178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:15.574623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:15.575376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:15.575946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:15.859206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:15.867088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-19e4dbc5-d302-4be9-9c00-f9dbab087e71 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.303869 Jun 15 10:57:15.867643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1819/3742] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:15 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:16.026565 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:16.027193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:16.034278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.034717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:16.035465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.035894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:16.164507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:16.172850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d825005c-bd7d-454e-96d5-f881b312394c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150081 Jun 15 10:57:16.173644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1924/3743] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:16 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:16.450470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:16.451317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:16.457401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.457850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:16.458631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.459049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:16.524873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:16.534474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:16.535990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:16.537365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dea20d57-934a-42c5-a938-351b680d923f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090806 Jun 15 10:57:16.537911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1820/3744] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:16 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:16.885122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:16.885745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:16.893050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.893497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:16.894258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:16.894693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:17.024076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:17.032470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-855d3de0-527e-41b0-bcdc-52fd323b0d51 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.151245 Jun 15 10:57:17.033054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1925/3745] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:16 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:17.190796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:17.191351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:17.197960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:17.198446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:17.199162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:17.199597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:17.332377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:17.340312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-074aca64-67d1-4ddf-8f0d-8090030386b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153403 Jun 15 10:57:17.341138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1821/3746] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:17 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:17.556809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:17.557474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:17.563895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:17.564343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:17.565141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:17.565607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:17.629403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:17.637816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:17.640035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:17.641200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3ab16c7c-83af-45dc-9da0-6a86160749aa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089102 Jun 15 10:57:17.641756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1926/3747] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:17 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:18.051026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:18.051631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:18.057816 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.058257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.059008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.059445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.190854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:18.194763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:18.199799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-941438c0-e87f-4ce7-b03b-e2fef8271eff tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153003 Jun 15 10:57:18.200367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1822/3748] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:18 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:18.359707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:18.360243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:18.366839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.367272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.368023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.368448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.498156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:18.506285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9eea6e2-8753-4e6d-a763-0f71fde46592 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.151617 Jun 15 10:57:18.506847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1927/3749] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:18 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:18.658745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:18.659278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:18.665394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.665840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.666600 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:18.667036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:18.732835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:18.741269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:18.742740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:18.743863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0ace479e-2ec0-4b35-8e5e-d290089a53c3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089424 Jun 15 10:57:18.744406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1823/3750] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:18 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:19.224858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:19.225492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:19.231667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.232288 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.233206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.233650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.368575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:19.377353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-338842cf-5d5c-43af-97ba-91c7a6c2aa79 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156246 Jun 15 10:57:19.377915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1928/3751] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:19 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:19.524008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:19.524556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:19.532610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.533106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.533900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.534342 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.668020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:19.676204 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b2621308-ae28-4353-9ec3-4a036751ee63 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156194 Jun 15 10:57:19.676754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1824/3752] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:19 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:19.765709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:19.766297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:19.772419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.772857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.773645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:19.774121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:19.838711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:19.848335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:19.849843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:19.850977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-06af9d01-6410-4270-8af7-447aca4d9abc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089903 Jun 15 10:57:19.851526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1929/3753] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:19 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:20.395185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:20.395790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:20.402389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.402837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.403827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.404723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.539287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:20.548013 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25f29180-8de3-4560-a49d-706ef761f573 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156700 Jun 15 10:57:20.548565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1825/3754] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:20 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:20.693924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:20.694479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:20.702557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.703204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.704073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.704657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.844065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:20.852364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a2fd51e7-9479-46b8-a342-0e42cb0671fe tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.162466 Jun 15 10:57:20.852937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1930/3755] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:20 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:20.869746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:20.870357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:20.877180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.877627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.878386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:20.878812 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:20.944517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:20.954022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:20.955524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:20.956653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-09060ac8-b0c1-4036-bdbf-1ad5ca2f4e8a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091062 Jun 15 10:57:20.957231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1826/3756] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:20 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:21.565336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:21.565949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:21.571998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.572446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:21.573237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.573668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:21.700651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:21.709139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8603e42c-70e9-4c5d-af63-1c4937e70701 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.147851 Jun 15 10:57:21.709711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1931/3757] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:21 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:21.870030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:21.870611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:21.877933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.878375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:21.879326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.879748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:21.974860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:21.975465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:21.981413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.981848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:21.982605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:21.983034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:22.013253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:22.022785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b351306-597c-4567-b2c4-78bc0bc634c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156818 Jun 15 10:57:22.023345 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1827/3758] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:21 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:22.049342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:22.058283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:22.059807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:22.061003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ae0354ce-4d1f-4a1c-976d-4262c03c57fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089952 Jun 15 10:57:22.062358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1932/3759] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:21 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:22.727789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:22.728401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:22.735419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:22.735864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:22.736629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:22.737088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:22.886042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:22.895046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-038ce711-fff4-4247-8ebc-568ea4e9b34f tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.170954 Jun 15 10:57:22.895608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1828/3760] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:22 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:23.041456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:23.042321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:23.050976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.051434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:23.052184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.052621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:23.082103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:23.082624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:23.090680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.091380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:23.092231 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.092691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:23.174233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:23.182592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:23.184075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:23.185271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0a29dd8-c0f3-4590-baad-d152ae25590e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.107076 Jun 15 10:57:23.185830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1829/3761] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:23 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:23.217687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:23.226764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6d5b5db8-ad49-410e-adbf-bd2527f4f829 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.189041 Jun 15 10:57:23.227342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1933/3762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:23 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:23.913543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:23.914123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:23.920440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.920886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:23.921748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:23.922230 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:24.056376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:24.065052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-74c44a7f-a77d-4f2e-9291-b67c9e777226 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155475 Jun 15 10:57:24.065840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1830/3763] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:23 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:24.203860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:24.204530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:24.211330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:24.211773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:24.212532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:24.213007 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:24.245360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:24.245974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:24.253211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:24.253670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:24.254448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:24.254889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:24.276432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:24.285423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:24.286899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:24.288026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-daa727db-8f57-4830-8f94-3f57e3b53961 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088818 Jun 15 10:57:24.288580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1934/3764] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:24 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:24.390055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:24.398049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc6fd594-c064-4969-addf-56fcf636e045 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.156440 Jun 15 10:57:24.398585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1831/3765] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:24 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:25.083129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:25.083737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:25.089838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.090276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.091272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.091700 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.228247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:25.236486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ddd1914f-7dc7-4a15-b473-7f0ccfb8f754 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.158304 Jun 15 10:57:25.237065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1935/3766] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:25 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:25.307256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:25.307815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:25.314564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.315036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.315866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.316322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.377952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:25.386422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:25.387885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:25.389038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b899534-7b3d-46c2-aac5-3cdbb5116b89 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.085997 Jun 15 10:57:25.389585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1832/3767] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:25 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:25.416281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:25.416923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:25.423051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.423772 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.424260 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:25.424695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:25.428651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:25.554643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:25.562822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-324997c0-f140-4963-98e7-39e712956114 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150408 Jun 15 10:57:25.563374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1936/3768] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:25 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:26.253972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:26.254571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:26.260706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.261357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.262114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.262542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.390585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:26.400163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8a7e8bce-3aa8-4b8c-ad61-fc25eb628aea tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149966 Jun 15 10:57:26.400723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1833/3769] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:26 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:26.407555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:26.409247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:26.415423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.415868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.416629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.417125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.480545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:26.489103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:26.490585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:26.491718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0739d95f-0444-4318-99a1-26dca7f08064 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088188 Jun 15 10:57:26.492266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1937/3770] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:26 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:26.582348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:26.583097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:26.589205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.589739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.590486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:26.590914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:26.724091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:26.732312 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9efb6372-7525-43d0-abda-4a8fb2dc2f15 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155034 Jun 15 10:57:26.732875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1834/3771] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:26 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:27.418728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:27.419311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:27.425971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.426407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.427172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.428240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.510591 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:27.511232 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:27.518008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.518450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.519221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.519653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.567124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:27.575612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-de9f417b-e977-45c7-b7db-24a34802ee37 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.160860 Jun 15 10:57:27.576178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1938/3772] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:27 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:27.585794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:27.594433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:27.595905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:27.597061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50a18ed9-5c2d-48d9-a7a6-57b7902fe51f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090534 Jun 15 10:57:27.597610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1835/3773] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:27 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:27.749889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:27.750494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:27.756590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.757071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.757827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:27.758255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:27.889456 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:27.898316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-771e8730-beb7-4476-8e84-f8c76f23c8c5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152168 Jun 15 10:57:27.898880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1939/3774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:27 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:28.593246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:28.593856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:28.600507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.601131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:28.601893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.602332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:28.615453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:28.616051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:28.623325 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.623767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:28.624516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.624941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:28.687451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:28.697215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:28.698713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:28.699856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a76e88c3-7bfa-4eb1-aa21-a81c56402901 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.088466 Jun 15 10:57:28.700412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1940/3775] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:28 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:28.740068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:28.748993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-283d4c5d-d7ae-48fe-947e-2351530ab2d8 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.159870 Jun 15 10:57:28.749547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1836/3776] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:28 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:28.916327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:28.916875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:28.923110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.923546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:28.924293 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:28.924718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:29.059244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:29.067436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e28d90c1-5bb3-49de-b831-28ce8ec91f47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.155718 Jun 15 10:57:29.068014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1941/3777] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:28 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:29.718496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:29.719259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:29.721398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=76 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:29.726205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:29.726677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:29.727654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:29.728088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:29.766541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:29.767154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:29.774289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:29.774757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:29.775688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:29.776113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:29.794306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:29.802919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:29.804469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:29.805827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20144993-9324-4f70-8478-630da44a227e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091681 Jun 15 10:57:29.806385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1837/3778] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:29 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:29.910335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:29.919706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-98bc122b-e2f2-4042-a1ce-04cb920861a1 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.156723 Jun 15 10:57:29.920287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1942/3779] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:29 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:30.084786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:30.085328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:30.091956 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.092400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.093185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.093612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.199452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:57:30.199705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 10:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 (ip 10.222.0.60) !!! Jun 15 10:57:30.224831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:30.233003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a996529c-0aac-46a6-86f6-3843300a5bf2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.152069 Jun 15 10:57:30.233562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1838/3780] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:30 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:30.824311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:30.824873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:30.831580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.832025 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.832811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.833280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.895563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:30.904658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:30.906199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:30.907320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c25c49a-0dc3-4257-a72a-cb6379ad22e4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.087399 Jun 15 10:57:30.907881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1943/3781] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:30 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:30.939289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:30.939891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:30.946659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.946980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.947746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:30.948179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:30.967136 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:31.076731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:31.084589 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f79cf731-abb4-4e57-9166-366cd436bb22 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.149102 Jun 15 10:57:31.085170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1839/3782] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:30 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:31.251190 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:31.251799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:31.258017 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:31.259116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:31.260014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:31.260450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:31.397079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:31.405333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-83af36f3-cb37-41f9-a612-de858f7d048e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.158195 Jun 15 10:57:31.405899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1944/3783] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:31 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:31.925787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:31.926396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:31.933184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:31.933636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:31.934565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:31.935007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:32.000443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:32.009155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:32.010633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:32.011768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-04fa86cf-7f69-4b3e-8310-8c63c3a05c77 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089886 Jun 15 10:57:32.012328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1840/3784] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:31 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:32.103695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:32.104309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:32.110983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:32.111532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:32.112332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:32.112770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:32.244290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:32.252411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e8c92d85-86e7-41e2-a387-05b430709bf6 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153193 Jun 15 10:57:32.252981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1945/3785] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:32 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:32.422667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:32.423275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:32.429396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:32.429847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:32.430617 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:32.431041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:32.560613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:32.568769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8077061-b428-4b64-9f1d-85f31e44cae6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150005 Jun 15 10:57:32.569377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1841/3786] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:32 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:33.029301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:33.029912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:33.031769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=82 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:33.036847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.037453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.043607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.043607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.106409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:33.115355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:33.116832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:33.118552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a06765a1-583d-4c7e-b7d3-0594fd463761 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093212 Jun 15 10:57:33.119231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1946/3787] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:33 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:33.269931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:33.270650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:33.277536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.277982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.278741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.279167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.410913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:33.419865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-619babef-25d9-4db2-a66a-5719328e30aa tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153683 Jun 15 10:57:33.420437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1842/3788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:33 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:33.587178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:33.587811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:33.594202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.594696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.595387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:33.595810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:33.726664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:33.735902 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5556815c-5c3f-4568-9a21-e25564b6d1f9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.153409 Jun 15 10:57:33.736471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1947/3789] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:33 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:34.137157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:34.137792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:34.143993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.144437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.145302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.145770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.213011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:34.221881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:34.223377 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:34.224506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3cda7fd-227c-4164-afec-a2d61e237c54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.092018 Jun 15 10:57:34.225096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1843/3790] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:34 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:34.437294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:34.437845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:34.444368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.444812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.445615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.446069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.578664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:34.587448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-06753290-ba33-43e7-a6d2-93e2a7d579c5 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153515 Jun 15 10:57:34.588014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1948/3791] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:34 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:34.754118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:34.754734 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:34.762142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.762595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.763358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:34.763794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:34.896277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:34.905064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cc88c28c-330b-4d07-afbb-e3d203297971 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.154820 Jun 15 10:57:34.912093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1844/3792] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:34 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:35.241810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:35.242418 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:35.249533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.249977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:35.250744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.251171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:35.319399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:35.329012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:35.330491 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:35.331645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-70c39b15-51c9-4428-8f53-5defd0dfdf35 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.093763 Jun 15 10:57:35.332269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1949/3793] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:35 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:35.606154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:35.606769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:35.612865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.613335 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:35.614083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.614517 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:35.745513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:35.753771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-565909a6-9528-4d25-a478-db5594093547 tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.152711 Jun 15 10:57:35.754351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1845/3794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:35 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:35.927691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:35.928246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:35.935078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.935513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:35.936262 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:35.936695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:36.065909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:36.074553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ef371d9-862f-4dbe-a3bf-4a2d77004da2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150675 Jun 15 10:57:36.075170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1950/3795] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:35 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:36.350273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:36.350875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:36.357774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:36.358224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:36.358989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:36.359425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:36.424528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:36.433817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:36.435329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:36.436556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a3ad3682-ef26-4183-ab79-c499b4baece2 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.090132 Jun 15 10:57:36.437042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1846/3796] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:36 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:36.772916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:36.773638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:36.779956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:36.780464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:36.781280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:36.781710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:36.917061 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:36.925060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a2e0b02-2b86-4b8b-8763-4fa5c100b71c tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.155957 Jun 15 10:57:36.925627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1951/3797] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:36 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:37.159831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:37.160440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:37.167607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.168056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:37.168844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.169301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:37.302240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:37.310968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-563f65d9-f390-4fa0-b3c1-6df7cc141697 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.223008 Jun 15 10:57:37.311528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1847/3798] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:37 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:37.455056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:37.455660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:37.462181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.463658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:37.464453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.464877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:37.530544 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:37.533981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:37.539336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:37.541487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:37.542624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3c469c51-4fdb-4dca-9bc1-6b7e7cb1365b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.091459 Jun 15 10:57:37.543414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1952/3799] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:37 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:37.943052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:37.943564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] [instance: 3c7caeb5-c9cc-493c-94d7-cac63be29ff2] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:37.950788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.951236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:37.951992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:37.952426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:38.083485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a318aa610e449fb6e480372ee61db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40cd185858444d8aaf78e72a740b624f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:38.092572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0e4e153f-14bc-4533-af1a-55e9c7c0b50b tempest-VolumesSnapshotTestJSON-457125394 tempest-VolumesSnapshotTestJSON-457125394-project] 10.222.0.60 "GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2" status: 200 len: 1559 microversion: 2.1 time: 0.153189 Jun 15 10:57:38.093163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1848/3800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:37 2022] GET /compute/v2.1/servers/3c7caeb5-c9cc-493c-94d7-cac63be29ff2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:38.329044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:38.329649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:38.335763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:38.336203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:38.336947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:38.337462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:38.466927 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:38.475081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cda50045-37c1-4ccb-9173-0a78c2492171 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 200 len: 1727 microversion: 2.1 time: 0.150360 Jun 15 10:57:38.475634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1953/3801] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:38 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:38.492540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df9920d7-55d7-4a78-8b82-3c49c752d983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '.version_select at 0x7fc27a139160>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:38.496235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df9920d7-55d7-4a78-8b82-3c49c752d983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [0bc838b1-f5b4-4c4a-ad80-26abfd9d47fd] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 10:57:38.561782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:38.562381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:38.568728 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:38.569204 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:38.569967 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:38.570375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:38.636447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:38.644789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:38.646282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:38.647391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f164f4a7-7276-41d2-a0ec-2075cce556f9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 200 len: 1444 microversion: 2.20 time: 0.089679 Jun 15 10:57:38.647965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1954/3802] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:38 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:38.664598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28197bc0-a87b-4404-b26b-3c6cc6fcc917 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '.version_select at 0x7fc27df17ca0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:38.766687 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28197bc0-a87b-4404-b26b-3c6cc6fcc917 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649871053" status: 204 len: 0 microversion: 2.20 time: 0.105504 Jun 15 10:57:38.767283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1955/3803] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Jun 15 10:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1649871053 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 10:57:39.503733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-df9920d7-55d7-4a78-8b82-3c49c752d983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [0bc838b1-f5b4-4c4a-ad80-26abfd9d47fd] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 38834. Jun 15 10:57:39.595953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df9920d7-55d7-4a78-8b82-3c49c752d983 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-129715895" status: 202 len: 0 microversion: 2.1 time: 1.107054 Jun 15 10:57:39.596826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1849/3804] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Jun 15 10:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-129715895 => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:57:39.694292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6558b24e-123d-4cac-b106-d0098afb3975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: .version_select at 0x7fc2796cc430>, body: {"keypair": {"name": "tempest-keypair-630401169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlFo1UPkm2tHKWfBWKaTZkAv0stHbxdW9omM4QPm/eicppTw0KKZoDg8NT88yuDp7YrWGqclR9XWQB7GHd9aizvj8SF2DTASyhXHu6Xs9Frk0Q1afUrWf+symB9yt1L0A=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:39.710581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-6558b24e-123d-4cac-b106-d0098afb3975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:57:39.714562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-6558b24e-123d-4cac-b106-d0098afb3975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for user bbb69faf3ec54489a92fe87935f2f777 and project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:57:39.800692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6558b24e-123d-4cac-b106-d0098afb3975 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.110425 Jun 15 10:57:39.801254 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1956/3805] 10.222.0.60 () {62 vars in 1199 bytes} [Wed Jun 15 10:57:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 10:57:40.810955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-fbf76bb1-2be3-48f9-89db-473f85830d03 req-5cda1b45-8aa5-4919-84ed-81464a55dc96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4944d55-b710-413e-81ed-24e682fa5479", "tag": "27e773d4-aed6-4a80-bac1-bbb3f07bf3e2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:40.826393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-fbf76bb1-2be3-48f9-89db-473f85830d03 req-5cda1b45-8aa5-4919-84ed-81464a55dc96 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:40.830847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-fbf76bb1-2be3-48f9-89db-473f85830d03 req-5cda1b45-8aa5-4919-84ed-81464a55dc96 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:40.841454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-fbf76bb1-2be3-48f9-89db-473f85830d03 req-5cda1b45-8aa5-4919-84ed-81464a55dc96 service nova] Creating event network-changed:27e773d4-aed6-4a80-bac1-bbb3f07bf3e2 for instance c4944d55-b710-413e-81ed-24e682fa5479 on hv-cinder-84580 Jun 15 10:57:40.849101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-fbf76bb1-2be3-48f9-89db-473f85830d03 req-5cda1b45-8aa5-4919-84ed-81464a55dc96 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115135 Jun 15 10:57:40.850383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1850/3806] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:57:40.907269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-495efdb0-34c8-48bf-a45a-3b1dccb52e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: .version_select at 0x7fc279737d30>, body: {"keypair": {"name": "tempest-keypair-1498563650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClHoI/PmgheGRGmKsUYJY9sl7oqXZljSBuaf36xoj+whOARtIxbePUSrMvkchuA2AirexOFZ64L/6uxPGd15c0lDAF67tBxtBCuzFPpNlCVEH4CjZqhibxBkuIlPg1rcA=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:40.924098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-495efdb0-34c8-48bf-a45a-3b1dccb52e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:57:40.928907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-495efdb0-34c8-48bf-a45a-3b1dccb52e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:57:41.030607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-495efdb0-34c8-48bf-a45a-3b1dccb52e62 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127764 Jun 15 10:57:41.031717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1957/3807] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:57:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:57:42.981372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-67431970", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ed61d18-d787-4760-a0a1-dc4388f6afaf"}], "security_groups": [{"name": "tempest-securitygroup--1727642962"}], "key_name": "tempest-keypair-630401169", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:43.090839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] validate_networks() for [('8ed61d18-d787-4760-a0a1-dc4388f6afaf', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:57:43.547518 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:57:43.548012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:57:43.548602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:57:43.549187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:57:43.549671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:57:43.559218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:43.559675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:43.560472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:43.560908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:43.578861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:57:43.582811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Getting quotas for user bbb69faf3ec54489a92fe87935f2f777 and project bbcfca56769742b9b3645f8f7c9bc6e3. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:57:43.594688 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:57:43.597066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:57:43.733445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-69002863", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae25dc20-3f67-427a-9874-3a8b1d755278"}], "security_groups": [{"name": "tempest-securitygroup--2024729223"}], "key_name": "tempest-keypair-1498563650", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:43.746053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4126e648-a8cc-4e4d-9882-a05fc7f66312 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.770132 Jun 15 10:57:43.751103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1851/3808] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Jun 15 10:57:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:57:43.756626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:43.757346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:43.816191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:43.826296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:43.841285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:43.841285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cecd00b1-3dc0-49da-a39b-23e9aa858b5a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1279 microversion: 2.20 time: 0.076659 Jun 15 10:57:43.841285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1852/3809] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:43 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1279 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:43.869118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] validate_networks() for [('ae25dc20-3f67-427a-9874-3a8b1d755278', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:57:44.328501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:57:44.328951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:57:44.329436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:57:44.329882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:57:44.330309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:57:44.339839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:44.340574 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:44.341387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:44.341815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:44.359515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:57:44.363765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:57:44.376103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:57:44.378377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:57:44.517401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7d1eb7ad-4289-4230-b1f6-f4ddc1a4bcaa tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.789835 Jun 15 10:57:44.518078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1958/3810] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:57:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:57:44.528339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dba7ee19-7fe4-48e9-8fd6-e6b790962d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:44.529308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dba7ee19-7fe4-48e9-8fd6-e6b790962d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:44.590459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dba7ee19-7fe4-48e9-8fd6-e6b790962d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:44.596203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dba7ee19-7fe4-48e9-8fd6-e6b790962d06 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1240 microversion: 2.1 time: 0.071925 Jun 15 10:57:44.596772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1853/3811] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:44 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:44.849232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:44.849874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:44.857617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:44.858044 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:44.858811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:44.859369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:44.922791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:44.931525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:44.933553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:44.934834 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8d2f30b7-9b6d-4166-b6e6-e0817a68ad1e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1283 microversion: 2.20 time: 0.089511 Jun 15 10:57:44.935675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1959/3812] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:44 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1283 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:45.613677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:45.614293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:45.622755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:45.623205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:45.623982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:45.624421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:45.689723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:45.698791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dd93dd79-2615-48e1-9b84-e20a20ce8cc5 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1244 microversion: 2.1 time: 0.088832 Jun 15 10:57:45.699332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1854/3813] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:45 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:45.953138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:45.953875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:45.960462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:45.960901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:45.961685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:45.962150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:46.027762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:46.036324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:46.037855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:46.039000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fcbc08b5-6313-43fb-a0b1-dcb98c0be1f0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1331 microversion: 2.20 time: 0.089827 Jun 15 10:57:46.039546 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1960/3814] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:45 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1331 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:46.716277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:46.716906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:46.724380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:46.724826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:46.725647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:46.726087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:46.823610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:46.831352 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f640d9d9-cbe2-4dd8-80d2-c0757c0f0ec6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1292 microversion: 2.1 time: 0.119588 Jun 15 10:57:46.832148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1855/3815] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:46 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:47.068657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:47.069414 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:47.077542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:47.077992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:47.078920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:47.079572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:47.265178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:47.282520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:47.284094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:47.286571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28d7e9c0-206e-4c12-a85d-af25e4cd0e5c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.221748 Jun 15 10:57:47.287397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1961/3816] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:47 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:47.856822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:47.856822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:47.863967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:47.864420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:47.865268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:47.865715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:47.949360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:47.957356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e0e9369b-03c3-46b7-94de-32aa7ec220d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1298 microversion: 2.1 time: 0.105980 Jun 15 10:57:47.957935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1856/3817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:47 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:48.308147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:48.308771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:48.315857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:48.316302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:48.317115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:48.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:48.415154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-7cb73e2b-303b-479f-a0bf-7e61a8ad712e req-c4cee91b-3713-471b-b994-355bb62287ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:48.442088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7cb73e2b-303b-479f-a0bf-7e61a8ad712e req-c4cee91b-3713-471b-b994-355bb62287ec service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:48.442543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-7cb73e2b-303b-479f-a0bf-7e61a8ad712e req-c4cee91b-3713-471b-b994-355bb62287ec service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:48.459198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-7cb73e2b-303b-479f-a0bf-7e61a8ad712e req-c4cee91b-3713-471b-b994-355bb62287ec service nova] Creating event network-changed:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 10:57:48.467454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-7cb73e2b-303b-479f-a0bf-7e61a8ad712e req-c4cee91b-3713-471b-b994-355bb62287ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054344 Jun 15 10:57:48.469084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1857/3818] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:57:48.496931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:48.512625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:48.514345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:48.516752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fb85cefa-d494-492f-947c-5e8c2d4901ca tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.211844 Jun 15 10:57:48.531916 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1962/3819] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:48 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:48.976548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:48.977287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:48.985796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:48.986525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:48.987297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:48.987727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.252845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:49.261873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b7bdd2c9-974b-40d3-a74d-ae5eb837d094 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.289705 Jun 15 10:57:49.262460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1858/3820] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:48 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:49.539550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:49.542219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:49.553883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.554602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.555563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.556603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.686797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:49.690402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:49.694125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.694594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.695354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.695768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.723740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:57:49.751245 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:49.761560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:49.763562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:49.764997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a82e029-fa43-4144-a2e1-f4e88ddf32dd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.229311 Jun 15 10:57:49.765703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1963/3821] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:49 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:49.777000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:49.777000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:49.780577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.781159 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.782014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:49.782704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:49.818650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:57:49.881601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:50.098396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0cf88e00-2b3b-48fb-a6a0-cd92bc436ac3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 204 len: 0 microversion: 2.1 time: 0.415043 Jun 15 10:57:50.099061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1859/3822] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:57:49 2022] DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:57:50.115223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:50.118067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:50.125543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.125987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.126759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.127208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.211545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52aeaf3c-8b64-4d88-aec1-c9c97f9a49eb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 204 len: 0 microversion: 2.1 time: 0.443821 Jun 15 10:57:50.212137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1964/3823] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:57:49 2022] DELETE /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:57:50.221166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:50.223906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:50.228143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.228639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.229570 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.229897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.269152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.280528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82ef5f0e-a258-4aa8-a0f5-3386540c6bc6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1719 microversion: 2.1 time: 0.175062 Jun 15 10:57:50.281341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1860/3824] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:50.285926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:50.287516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:50.295515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.295965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.296715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.297201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.390119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.399142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-13d0ed23-69c1-4bdf-a738-1ba606b2d5a1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.182439 Jun 15 10:57:50.399706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1965/3825] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:50.455079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.463842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3e3ca2b7-7b20-46f4-85ff-8deb2530785f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.181165 Jun 15 10:57:50.464072 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1861/3826] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:50 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:50.488148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-afe8a4b6-624c-445e-93e5-987930860e7c req-4b058606-623c-4f20-a23d-069f8b3fb3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4151473-56b5-415e-b577-98d34aa05543", "tag": "baad251a-2964-4773-bb6a-55d7aed2608e"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:50.496980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-afe8a4b6-624c-445e-93e5-987930860e7c req-4b058606-623c-4f20-a23d-069f8b3fb3ad service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.497427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-afe8a4b6-624c-445e-93e5-987930860e7c req-4b058606-623c-4f20-a23d-069f8b3fb3ad service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.508220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-afe8a4b6-624c-445e-93e5-987930860e7c req-4b058606-623c-4f20-a23d-069f8b3fb3ad service nova] Creating event network-changed:baad251a-2964-4773-bb6a-55d7aed2608e for instance f4151473-56b5-415e-b577-98d34aa05543 on hv-cinder-84580 Jun 15 10:57:50.513342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-afe8a4b6-624c-445e-93e5-987930860e7c req-4b058606-623c-4f20-a23d-069f8b3fb3ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028767 Jun 15 10:57:50.513928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1966/3827] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:57:50.782675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:50.783275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:50.789544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.790015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.790827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:50.792000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:50.924385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.932764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.934304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:50.935408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c25d9268-3daf-41f7-9987-54a913738ddc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.156889 Jun 15 10:57:50.935958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1862/3828] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:50 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:51.299023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:51.299711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:51.306033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.306474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.307327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.307767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.427083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:51.427083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:51.431322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.431767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.432543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.433007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.446169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:51.455853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-18dff75c-cda3-48f4-9592-9afdab52cea0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1719 microversion: 2.1 time: 0.161340 Jun 15 10:57:51.456784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1967/3829] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:51.481385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:51.482091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:51.488027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.488468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.489305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.489735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.574383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:51.582598 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-663ad818-8176-4f77-9c33-081155797e03 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.168599 Jun 15 10:57:51.583175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1863/3830] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:51 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:51.644798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:51.652999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-82cab022-9936-4a63-b8de-d78e8dd57cbb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.175954 Jun 15 10:57:51.653569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1968/3831] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:51 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:51.954049 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:51.954696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:51.960898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.961380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:51.962179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:51.962620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.094905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:52.103011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:52.105305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:52.106414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a880facf-a41e-4c3c-bbff-b0b56306b817 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.156284 Jun 15 10:57:52.107040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1864/3832] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:51 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:52.474420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:52.475708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:52.484237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.485172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.486150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.487128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.600215 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:52.601556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:52.610069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.614927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.614927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.614927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.637334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:52.646594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c0d556dc-6ec2-4e85-a3a1-678b8325468a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1719 microversion: 2.1 time: 0.176073 Jun 15 10:57:52.647440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1969/3833] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:52.670677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:52.671297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:52.677944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.678388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.679168 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:52.679600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:52.819084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:52.827732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-38512559-6141-4707-af6f-13b05beb74c2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.161440 Jun 15 10:57:52.828383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1970/3834] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:52 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:53.072168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:53.081727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3363916f-cc1d-4de9-9db4-6ff0c15a1875 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.485715 Jun 15 10:57:53.082297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1865/3835] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:53.124988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:53.125649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:53.132114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.132564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.133376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.133812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.275689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:53.284496 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:53.286008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:53.287114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c099c90-ff55-4445-bb41-cd3a84b96781 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.167307 Jun 15 10:57:53.287672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1971/3836] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:53 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:53.665032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:53.665778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:53.668307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:53.673759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.674205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.674967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.675403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.844525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:53.845163 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:53.851901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.852348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.853148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:53.853643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:53.858993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:53.944642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:53.956732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c23c5259-88d0-40ba-85c5-eb697deb6658 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1719 microversion: 2.1 time: 0.295424 Jun 15 10:57:53.958181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1866/3837] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1719 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:54.028200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:54.036628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-61b651f5-21c6-40e6-9714-a46dfd90eb98 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.196153 Jun 15 10:57:54.048150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1972/3838] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:53 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:54.101168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:54.101996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:54.111096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.111725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:54.112575 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.113114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:54.306354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:54.309521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:54.314221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.314672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:54.315592 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.316031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:54.351778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:54.364609 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:54.371797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=14 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:54.377478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3b9d0a45-ceec-412e-bed3-df2143510f1f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.281141 Jun 15 10:57:54.386067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1867/3839] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:54.474991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:54.483722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:54.485267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:54.486374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c1a95830-1fad-4513-bdc0-c40292ec3a76 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.184592 Jun 15 10:57:54.486938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1973/3840] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:54 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:54.977135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:54.977928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:54.980814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:54.986085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.986906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:54.988606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:54.989036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.008298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-aab0b7b7-60f7-4533-a587-a8db3822f586 req-8db06eb3-0e2e-4cd3-8c82-4f8f78348ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3a5478-7be1-4af4-913f-48a2c5ee7199", "name": "network-vif-deleted", "tag": "b7da9a2f-05fc-414c-ae2d-5271d90eaedb"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:55.013872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:55.020229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-aab0b7b7-60f7-4533-a587-a8db3822f586 req-8db06eb3-0e2e-4cd3-8c82-4f8f78348ae8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.021255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-aab0b7b7-60f7-4533-a587-a8db3822f586 req-8db06eb3-0e2e-4cd3-8c82-4f8f78348ae8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.034128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-aab0b7b7-60f7-4533-a587-a8db3822f586 req-8db06eb3-0e2e-4cd3-8c82-4f8f78348ae8 service nova] Creating event network-vif-deleted:b7da9a2f-05fc-414c-ae2d-5271d90eaedb for instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 on hv-cinder-84580 Jun 15 10:57:55.040122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-aab0b7b7-60f7-4533-a587-a8db3822f586 req-8db06eb3-0e2e-4cd3-8c82-4f8f78348ae8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035535 Jun 15 10:57:55.040729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1974/3841] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:57:55.059605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:55.060771 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:55.065753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.068708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.069473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.070493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.071023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.076616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94a11a82-a34b-4dad-9b6e-bad2b12be64f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1651 microversion: 2.1 time: 0.104398 Jun 15 10:57:55.086823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1868/3842] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1651 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:55.224400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.234795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf6ec43a-7c3a-46b1-945a-79680944efb1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.180242 Jun 15 10:57:55.235356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1975/3843] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:55 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:55.395905 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:55.396521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:55.404338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.404795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.405628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.406063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.504276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:55.505228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:55.522451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.522897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.523952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:55.524424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:55.564630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.573878 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2f217fa-0d1e-4354-aac0-f91fc1a88bf9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.181799 Jun 15 10:57:55.574806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1869/3844] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:55.678324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.686483 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.687888 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:55.689055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51966912-cca5-4038-afe8-a326e51d2170 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.189198 Jun 15 10:57:55.689619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1976/3845] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:55 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:57:56.094641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:56.095288 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:56.101881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.102333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.103108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.103538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.166918 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.175019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4665caf1-4b4a-4300-a0cd-0102a12ce084 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1651 microversion: 2.1 time: 0.084920 Jun 15 10:57:56.175576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1870/3846] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1651 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:56.253117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:56.254797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:56.260449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.260889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.262357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.262792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.399080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.406527 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5d7c9bb0-fcc7-420f-b65d-8e1f103c10d3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.157728 Jun 15 10:57:56.407093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1977/3847] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:56 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:56.592647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:56.593548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:56.599798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.604126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.604126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.604126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.707867 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:56.708614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:56.716240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.716689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.717673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.718102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.736237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.744668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b726ef31-9974-4898-bd3c-717b48c90b18 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157282 Jun 15 10:57:56.745250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1871/3848] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:56.852386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.861466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.863713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:56.864626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c3b13a18-63e2-439b-bda3-4642ccb55cde tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.160678 Jun 15 10:57:56.865289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1978/3849] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:56 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:56.917542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-639a835b-1150-4ed8-9ba4-d03fb0806d8a req-3c9c4791-673a-4610-b825-f07604a21049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "name": "network-vif-plugged", "status": "completed", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:57:56.926296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-639a835b-1150-4ed8-9ba4-d03fb0806d8a req-3c9c4791-673a-4610-b825-f07604a21049 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:56.926727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-639a835b-1150-4ed8-9ba4-d03fb0806d8a req-3c9c4791-673a-4610-b825-f07604a21049 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:56.938668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-639a835b-1150-4ed8-9ba4-d03fb0806d8a req-3c9c4791-673a-4610-b825-f07604a21049 service nova] Creating event network-vif-plugged:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 10:57:56.943770 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-639a835b-1150-4ed8-9ba4-d03fb0806d8a req-3c9c4791-673a-4610-b825-f07604a21049 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086275 Jun 15 10:57:56.944356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1872/3850] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:57:57.192750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:57.193398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:57.201331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.202472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.202894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.203423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.287236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:57.296484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79bca7c6-cc69-4318-9e55-bf78f4900392 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1651 microversion: 2.1 time: 0.107538 Jun 15 10:57:57.297076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1979/3851] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1651 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:57.424919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:57.425583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:57.427561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:57.432483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.432930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.434365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.434875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.573718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:57.581647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c721e2b-3857-43e4-a590-e667c146de3a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.161387 Jun 15 10:57:57.584171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1873/3852] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:57 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:57.762782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:57.763393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:57.769660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.770152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.770892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.771316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.883623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:57.884234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:57.890767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.891213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.891987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:57.892420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:57.901178 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:57.910234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-32181090-85b3-4177-9ac6-78e66e2f8df5 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.151344 Jun 15 10:57:57.920494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1980/3853] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:58.025208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:58.034310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:58.035778 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:58.036892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b3cf117-65c5-4130-bf80-798c82dc7e6d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.157730 Jun 15 10:57:58.037467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1874/3854] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:57 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:58.314560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:58.315113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:58.321581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.322016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:58.322760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.323186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:58.384572 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:58.393642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e2f39991-e283-4a71-8b85-1709c7e18042 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083009 Jun 15 10:57:58.399814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1981/3855] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:58 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:58.600586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:58.601155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:58.607831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.608275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:58.609060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.609495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:58.740597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:58.749565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9b2d62be-1d5d-4a0a-86a9-2059cb5db4c3 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.153095 Jun 15 10:57:58.750139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1875/3856] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:58 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:57:58.928124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:58.928811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:58.935429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.935874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:58.936636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:58.937098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.054772 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:59.055389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:59.062381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.062831 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.063602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.064039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.070811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.079420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-416ec1e3-17a3-40de-ac58-acdaa7f086b6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155051 Jun 15 10:57:59.079987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1982/3857] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:58 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:59.196660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.200492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:57:59.207454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.209050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.210165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6e2f93a5-f94e-448f-a9e1-d8160da2d861 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1405 microversion: 2.20 time: 0.159364 Jun 15 10:57:59.210728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1876/3858] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:57:59 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:57:59.415056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:59.415720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:59.423290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.423885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.424581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.425103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.491484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.499864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8bde65c1-d8b7-4137-a12f-23a2de5a347a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.088855 Jun 15 10:57:59.504749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1983/3859] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:57:59.767761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:57:59.768482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:57:59.775746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.776187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.776971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:57:59.778373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:57:59.960802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:57:59.968240 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9a69b764-67a9-45cb-a270-82a7c5d24d49 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.204714 Jun 15 10:57:59.969085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1877/3860] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:57:59 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:00.097133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:00.097649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:00.103655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.104096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.104839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.105297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.229343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:00.229946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:00.235736 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:00.237367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.237813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.238578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.239007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.243908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a095c4c-3258-4f2c-bcb7-33b3c42aa3e3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.150777 Jun 15 10:58:00.244484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1984/3861] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:00.368627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:00.377446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:00.378928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:00.380075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8de7b69-c369-4a9a-8af4-bbbb452a7031 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1596 microversion: 2.20 time: 0.154612 Jun 15 10:58:00.380624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1878/3862] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:58:00 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:58:00.400366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:00.400854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:00.406944 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.407417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.408148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.408577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.488814 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-178fedde-74f5-45fb-afbc-e335d6c7372e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092358 Jun 15 10:58:00.489557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1985/3863] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Jun 15 10:58:00 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:58:00.515900 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:00.516507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:00.522653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.523101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.523869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.524336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.587048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:00.596627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a13ada6b-1661-462c-93f6-58398fcee759 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084888 Jun 15 10:58:00.597229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1879/3864] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:00.907413 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-856d66e3-8ee3-4b25-81c6-3812888979bd req-2e381e1c-6829-4f72-990a-8e315b55230f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4151473-56b5-415e-b577-98d34aa05543", "name": "network-vif-plugged", "status": "completed", "tag": "baad251a-2964-4773-bb6a-55d7aed2608e"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:58:00.916475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-856d66e3-8ee3-4b25-81c6-3812888979bd req-2e381e1c-6829-4f72-990a-8e315b55230f service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.917011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-856d66e3-8ee3-4b25-81c6-3812888979bd req-2e381e1c-6829-4f72-990a-8e315b55230f service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.929914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-856d66e3-8ee3-4b25-81c6-3812888979bd req-2e381e1c-6829-4f72-990a-8e315b55230f service nova] Creating event network-vif-plugged:baad251a-2964-4773-bb6a-55d7aed2608e for instance f4151473-56b5-415e-b577-98d34aa05543 on hv-cinder-84580 Jun 15 10:58:00.935770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-856d66e3-8ee3-4b25-81c6-3812888979bd req-2e381e1c-6829-4f72-990a-8e315b55230f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Jun 15 10:58:00.936359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1986/3865] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:58:00.985511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:00.986185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:00.992628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.993116 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:00.993882 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:00.994316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.143579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:01.151384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-27d2404d-05a9-4b26-9912-82e5bbf6c8cd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.169656 Jun 15 10:58:01.151912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1880/3866] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:00 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:01.262489 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:01.264976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:01.271292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:01.271740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.274431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:01.274431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.489283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:01.498016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e3f22b1e-2362-4e4e-9269-49772e0d1d66 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.239836 Jun 15 10:58:01.498678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1987/3867] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:01.566951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-70dca969-9df9-4827-8366-de5c3c404d62 req-57b4a803-1972-434e-abfd-8952dea28359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:58:01.575351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-70dca969-9df9-4827-8366-de5c3c404d62 req-57b4a803-1972-434e-abfd-8952dea28359 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:01.575791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-70dca969-9df9-4827-8366-de5c3c404d62 req-57b4a803-1972-434e-abfd-8952dea28359 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.587109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-70dca969-9df9-4827-8366-de5c3c404d62 req-57b4a803-1972-434e-abfd-8952dea28359 service nova] Creating event network-changed:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 10:58:01.593023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-70dca969-9df9-4827-8366-de5c3c404d62 req-57b4a803-1972-434e-abfd-8952dea28359 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029987 Jun 15 10:58:01.594184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1881/3868] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:58:01.614453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:01.615059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:01.621877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:01.622420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.623198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:01.623629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:01.691498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:01.700910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5e3b62cb-92b1-4fcc-9ab2-08aa2fbc4d6a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.090306 Jun 15 10:58:01.701895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1988/3869] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:02.169981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:02.170894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:02.176947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.177414 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.178174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.179030 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.312331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:02.320513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-39724e91-90ed-4462-9542-407b6be8dabb tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1366 microversion: 2.1 time: 0.155368 Jun 15 10:58:02.321220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1882/3870] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:02 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:02.515710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:02.516322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:02.524931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.524931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.524931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.525292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.671606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:02.680352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0041a776-4aab-4797-9870-23be6470b39b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.168956 Jun 15 10:58:02.680912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1989/3871] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:02.719004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:02.719973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:02.727974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.728419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.729458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:02.730135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:02.823890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:02.832930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d9246767-7f28-49d8-8ae7-b662c608f93c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.118704 Jun 15 10:58:02.833461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1883/3872] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:03.337578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:03.338181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:03.345157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.347497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.347497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.347497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.366338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:03.481394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:03.489207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0a90d525-c5f9-4c7c-976e-88deb470268c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1557 microversion: 2.1 time: 0.155373 Jun 15 10:58:03.489788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1990/3873] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:03 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:03.506406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:03.512750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:03.514201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.514654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.515459 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.515892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.595144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-41149dbd-4fcc-4fb0-b491-0d6dbfe84af4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092607 Jun 15 10:58:03.595759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1884/3874] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:58:03 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:58:03.698493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:03.700069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:03.707059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.710083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.710083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.710083 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.845194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:03.849950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:03.850676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:03.854041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-caba5934-ff69-408f-ac36-5e87fb3e4edb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159367 Jun 15 10:58:03.854620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1991/3875] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:03.857985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.860721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.860721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:03.860721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:03.979343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:03.987844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-174b7c29-a0db-4512-b60a-008f449490fd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.141672 Jun 15 10:58:03.988431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1885/3876] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:04.873530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:04.874137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:04.881285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:04.884529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:04.885422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:04.885858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:04.892192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-66cc3e2e-9bd4-4ef7-af68-028add0f7ab4 req-66bb17bf-08a7-4ef4-907b-41c3debc6fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4151473-56b5-415e-b577-98d34aa05543", "tag": "baad251a-2964-4773-bb6a-55d7aed2608e"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:58:04.901148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-66cc3e2e-9bd4-4ef7-af68-028add0f7ab4 req-66bb17bf-08a7-4ef4-907b-41c3debc6fb0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:04.901719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-66cc3e2e-9bd4-4ef7-af68-028add0f7ab4 req-66bb17bf-08a7-4ef4-907b-41c3debc6fb0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:04.913668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-66cc3e2e-9bd4-4ef7-af68-028add0f7ab4 req-66bb17bf-08a7-4ef4-907b-41c3debc6fb0 service nova] Creating event network-changed:baad251a-2964-4773-bb6a-55d7aed2608e for instance f4151473-56b5-415e-b577-98d34aa05543 on hv-cinder-84580 Jun 15 10:58:04.919594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-66cc3e2e-9bd4-4ef7-af68-028add0f7ab4 req-66bb17bf-08a7-4ef4-907b-41c3debc6fb0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030905 Jun 15 10:58:04.920483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1886/3877] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:58:05.005690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:05.005910 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:05.017543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:05.017543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:05.017543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:05.017543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:05.054493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:05.070603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dd93a215-6827-4dcd-a28c-d9c187f74dbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.201519 Jun 15 10:58:05.071371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1992/3878] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:05.140929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:05.150119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac8b057d-610c-4b64-99ac-f15bc48f2b87 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.149335 Jun 15 10:58:05.150999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1887/3879] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:06.088781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:06.089431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:06.096751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:06.097227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:06.097982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:06.098417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:06.169545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:06.170784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:06.178099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:06.178543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:06.179314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:06.180201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:06.233511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:06.241723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-18014a11-7014-45a5-b087-393c0bb29e99 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.156739 Jun 15 10:58:06.242302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1993/3880] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:06.243287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:06.251994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-25c34d32-eb93-407f-af64-211c356cba12 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086822 Jun 15 10:58:06.252415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1888/3881] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:07.259375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:07.259973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:07.267588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:07.268029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:07.268261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:07.268807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:07.268940 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:07.269244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:07.275570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:07.276027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:07.276833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:07.277391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:07.342309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:07.350873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e8fab789-dce6-4246-9b3d-fa5fdce93fae tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086251 Jun 15 10:58:07.351467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1889/3882] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:07.401462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:07.410094 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-95b4f374-fff1-4f6c-8945-7706ff8b728e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154521 Jun 15 10:58:07.410664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1994/3883] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:08.367529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:08.368145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:08.374763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:08.375203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:08.375965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:08.376399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:08.427624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:08.428232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:08.435228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:08.435680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:08.436454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:08.436892 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:08.441087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:08.449176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2e8ff989-0929-469e-b32a-92750b6acbaa tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085453 Jun 15 10:58:08.454726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1890/3884] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:08.570214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:08.579522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-44e4be02-f63f-48e8-b8b0-21b4f6a08f88 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155755 Jun 15 10:58:08.580097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1995/3885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:09.466464 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:09.467097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:09.473872 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:09.474314 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:09.475070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:09.475500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:09.539721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:09.548656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cea52e1c-b951-4471-8da9-b7a8b7cb0f47 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086758 Jun 15 10:58:09.549280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1891/3886] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:09 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:09.596664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:09.597318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:09.603874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:09.604320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:09.605118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:09.605550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:09.733065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:09.741139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7f61a1b-0c43-4f6f-8e4d-1c7eac4f133f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.148583 Jun 15 10:58:09.741725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1996/3887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:10.566483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:10.567089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:10.573798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:10.574243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:10.575699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:10.576075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:10.637730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:10.645728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0fa2943e-3945-4087-863f-b1e9ad3c31e6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083123 Jun 15 10:58:10.646287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1892/3888] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:10.758833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:10.759427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:10.767030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:10.767474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:10.768231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:10.768659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:10.908317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:10.916273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c51227c8-16f7-41d5-a889-04a31efce7ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.161290 Jun 15 10:58:10.916836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1997/3889] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:11.663156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:11.663764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:11.670482 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:11.670989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:11.671657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:11.672089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:11.735648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:11.743718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00fe9130-117c-4965-8001-2c4ec0a2d8c3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084286 Jun 15 10:58:11.744218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1893/3890] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:11.933652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:11.934240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:11.941561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:11.942005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:11.942760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:11.943191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:12.074903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:12.083919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2389feca-4e12-42e5-a87b-4592704801aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154162 Jun 15 10:58:12.084480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1998/3891] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:12.760641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:12.761264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:12.768069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:12.768508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:12.769292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:12.769722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:12.833689 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:12.842972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e5b7629e-5e25-4ef4-a300-24e21173b71e tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086121 Jun 15 10:58:12.843544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1894/3892] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:13.101709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:13.102258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:13.108860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:13.109342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:13.110108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:13.110545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:13.244026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:13.252253 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1a600e7-8a4e-41f3-ad88-58800a6ff4da tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154393 Jun 15 10:58:13.253050 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 1999/3893] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:13.861255 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:13.861860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:13.868732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:13.869207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:13.870064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:13.870495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:13.876371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:13.936461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:13.944683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e9fc25c4-cbdc-488e-bada-313925cb0c50 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.088476 Jun 15 10:58:13.945300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1895/3894] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:14.268881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:14.269576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:14.275613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:14.276052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:14.276797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:14.277351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:14.410751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:14.418633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-47964a5b-aa86-4c1f-8f35-d4a66248dc3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.153800 Jun 15 10:58:14.419826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2000/3895] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:14.964647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:14.965286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:14.972159 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:14.972606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:14.973401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:14.973839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:15.039087 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:15.047669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d79b5d9f-2820-4392-8016-553652513de4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086821 Jun 15 10:58:15.048246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1896/3896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:15.437909 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:15.438508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:15.445169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:15.445612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:15.446355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:15.446839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:15.580755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:15.588815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9431617a-f3bb-4471-be4e-3e44ef4e6faa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.156199 Jun 15 10:58:15.589426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2001/3897] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:16.064123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:16.064756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:16.071421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:16.071859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:16.072660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:16.073124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:16.135870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:16.144654 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98d550dc-9c47-47f0-a795-b51b5e76d964 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084886 Jun 15 10:58:16.145249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1897/3898] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:16.607535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:16.608173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:16.614763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:16.615209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:16.615965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:16.616395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:16.746228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:16.755122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1ac38466-f9ab-4e96-b7c9-113bf83d3f7c tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.152045 Jun 15 10:58:16.755825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2002/3899] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:17.162421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:17.163016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:17.170423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:17.170867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:17.171714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:17.172062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:17.237717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:17.245753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9131e965-ac4d-4165-a1c8-b8af2cfe7236 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087256 Jun 15 10:58:17.246317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1898/3900] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:17.771704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:17.772333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:17.779445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:17.779887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:17.780646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:17.781106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:17.909090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:17.917149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f487421-ec6a-4c87-8a9a-1fad610a04e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.149294 Jun 15 10:58:17.917713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2003/3901] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:18.262844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:18.263939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:18.270847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:18.271295 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:18.272050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:18.272476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:18.334837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:18.343507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b574d6a7-fc47-401e-8ba3-1fc5f2dc2579 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084631 Jun 15 10:58:18.344069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1899/3902] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:18.934650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:18.935310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:18.942019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:18.942459 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:18.943211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:18.943634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:19.078072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:19.086032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e2b1e533-b5a5-4843-b02a-a6af69858702 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155348 Jun 15 10:58:19.086595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2004/3903] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:18 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:19.360651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:19.361282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:19.367703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:19.368142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:19.368894 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:19.369346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:19.432545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:19.441310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-87f168b6-4070-42b9-adaa-f312f9d49a04 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084651 Jun 15 10:58:19.441869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1900/3904] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:19 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:20.104810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:20.105442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:20.112721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:20.113194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:20.113963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:20.114394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:20.245990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:20.254147 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ada09782-dd57-4be3-b0d2-65aaebc407ab tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.153202 Jun 15 10:58:20.254735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2005/3905] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:20.458225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:20.458815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:20.465488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:20.465951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:20.467526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:20.467958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:20.529225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:20.537982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56082fb3-5c78-4d21-bbdf-a66abe7cbc0f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083612 Jun 15 10:58:20.538540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1901/3906] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:21.270596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:21.271224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:21.277806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:21.278251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:21.280261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:21.280694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:21.414840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:21.423296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-540d4c4c-61f2-4823-b740-77067d0a4d37 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.156579 Jun 15 10:58:21.423855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2006/3907] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:21.556703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:21.557349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:21.568079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:21.568504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:21.569298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:21.569788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:21.635987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:21.644650 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d0ea82d4-a34d-469b-81ca-01d367f15f15 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.091771 Jun 15 10:58:21.645249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1902/3908] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:22.441962 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:22.442557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:22.449155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:22.449603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:22.450370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:22.451586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:22.456019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:22.591815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:22.600100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ee0a3e4-00e9-482c-ae5d-c745d753cfbc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.161969 Jun 15 10:58:22.600670 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2007/3909] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:22.661955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:22.662592 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:22.669790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:22.670238 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:22.671000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:22.671431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:22.734077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:22.742108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-35b25b4a-1ce6-423e-a71c-08a79c6712de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084043 Jun 15 10:58:22.742686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1903/3910] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:23.617898 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:23.618502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:23.628374 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:23.628843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:23.629702 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:23.630126 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:23.760080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:23.760271 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:23.760763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:23.768090 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:23.768546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:23.769088 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4164e519-091c-4027-9bb1-6613d99c8522 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155247 Jun 15 10:58:23.769547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:23.769663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2008/3911] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:23.769993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:23.834632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:23.842930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8058951-63f3-4480-a174-c2dedb7a9e53 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087309 Jun 15 10:58:23.843499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1904/3912] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:24.785963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:24.786571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:24.793745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:24.794128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:24.795863 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:24.796666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:24.861021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:24.861684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:24.867980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:24.868435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:24.869223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:24.869664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:24.938939 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:24.947631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:24.951909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa9c9514-1adc-4aff-b987-0a77bf02b090 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.091889 Jun 15 10:58:24.951909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1905/3913] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:24.957221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-595e8227-5a5c-453e-a566-ec16453e9813 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.175010 Jun 15 10:58:24.957806 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2009/3914] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:25.967651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:25.968268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:25.974529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:25.975136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:25.975510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:25.975963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:25.976745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:25.977205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:25.983022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:25.983466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:25.984230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:25.984668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:26.042921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:26.051388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0898dbd2-c25b-4f82-9c93-347658693061 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.088196 Jun 15 10:58:26.051977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1906/3915] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:26.343104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:26.351350 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-19fc5dc1-bef8-419b-851b-735304576e31 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.380921 Jun 15 10:58:26.351928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2010/3916] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:25 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:27.068719 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:27.069456 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:27.076604 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:27.077070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:27.077833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:27.078267 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:27.140813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:27.148773 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-53679761-647d-476e-83d4-e9790680de68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083871 Jun 15 10:58:27.149360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1907/3917] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:27.369239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:27.369773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:27.372026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=74 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:27.377647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:27.387922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:27.387922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:27.387922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:27.511270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:27.519662 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8c483250-197c-4b67-a6f6-d8faaaee324a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154304 Jun 15 10:58:27.520236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2011/3918] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:28.164759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:28.165349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:28.167693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=70 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:28.173050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:28.173505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:28.174269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:28.174706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:28.236410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:28.244495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d61d8931-4e09-4198-8822-9bb1846b0ab7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083710 Jun 15 10:58:28.245085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1908/3919] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:28.537220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:28.537824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:28.545092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:28.545710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:28.546472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:28.546906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:28.677170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:28.685059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-21e64602-1402-43e1-9c7d-975da008bbaf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.151680 Jun 15 10:58:28.685756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2012/3920] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:29.261608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:29.262243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:29.269387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:29.269836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:29.270597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:29.271031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:29.333386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:29.341835 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b7219087-faf3-455a-96f3-ca1aee4c55b1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083542 Jun 15 10:58:29.342400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1909/3921] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:29.703394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:29.704008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:29.710881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:29.711327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:29.712089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:29.712528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:29.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:29.847720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e86fcdc0-99de-49ce-8abf-a920fe0554dd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.149213 Jun 15 10:58:29.848312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2013/3922] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:30.358963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:30.359574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:30.366118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:30.366566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:30.367330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:30.367757 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:30.432570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:30.440656 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9e14235b-5747-4e77-9126-2335781e60b0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085698 Jun 15 10:58:30.441250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1910/3923] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:30 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:30.864952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:30.865588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:30.872122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:30.872569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:30.873925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:30.874392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:31.007141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:31.016282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a9ed545b-f5d6-4351-a446-66efa5f0c70b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155282 Jun 15 10:58:31.016788 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2014/3924] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:31.458005 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:31.458687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:31.465491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:31.465954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:31.467320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:31.468286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:31.533440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:31.536925 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:31.541921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee2da0ca-26ab-4663-ad08-608d8422cde4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087856 Jun 15 10:58:31.543063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1911/3925] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:32.034547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:32.035161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:32.041805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:32.042250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:32.043018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:32.043468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:32.179394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:32.188850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9708ad6f-f3c1-4a2b-acc2-e9696373802f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159099 Jun 15 10:58:32.189503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2015/3926] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:32.560556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:32.561713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:32.569237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:32.569682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:32.570493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:32.570958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:32.642065 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:32.650389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8d7749a5-d83b-4c65-a910-3418795ec852 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.093863 Jun 15 10:58:32.650975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1912/3927] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:32 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:33.207351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:33.207966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:33.214510 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:33.214949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:33.215709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:33.216135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:33.350720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:33.358798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-147b71fd-d106-448e-8280-8d0296261c0a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155355 Jun 15 10:58:33.359358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2016/3928] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:33.667698 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:33.668292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:33.675164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:33.675606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:33.676374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:33.676808 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:33.741026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:33.749807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-becebe22-2121-4100-b438-e3743496c69f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085998 Jun 15 10:58:33.750371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1913/3929] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:33 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:34.376844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:34.377484 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:34.384060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:34.384495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:34.385538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:34.385966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:34.523388 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:34.539227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c2fbc87b-4e4d-4e8e-8f86-96ca19d488f1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.167293 Jun 15 10:58:34.539816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2017/3930] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:34.766620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:34.767258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:34.773995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:34.774437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:34.775211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:34.775644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:34.841222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:34.849767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c3720870-a09d-40c2-ac3d-35dadd945220 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087009 Jun 15 10:58:34.850402 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1914/3931] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:34 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:35.556923 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:35.557554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:35.564495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:35.564934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:35.565715 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:35.566142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:35.698037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:35.706875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4b2f189e-ec26-45a2-b157-2f7a28269d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.153736 Jun 15 10:58:35.707447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2018/3932] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:35.867334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:35.867897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:35.876070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:35.876487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:35.877291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:35.877727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:35.942040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:35.950097 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f3825c06-9b55-441b-9b0a-76b193e01b18 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086671 Jun 15 10:58:35.950663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1915/3933] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:35 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:36.724724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:36.725382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:36.732296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:36.733334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:36.734104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:36.734543 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:36.882564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:36.891137 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8864b466-b3ee-455f-92d3-979224649588 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.170801 Jun 15 10:58:36.891724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2019/3934] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:36.968347 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:36.968989 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:36.975695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:36.976129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:36.976875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:36.977326 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:37.040790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:37.049078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ddfbd033-285d-469b-a09a-42ba8ec80e68 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085267 Jun 15 10:58:37.049642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1916/3935] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:36 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:37.909154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:37.909764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:37.916206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:37.916640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:37.917420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:37.917845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:38.049928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:38.057823 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d1f5e46-0a93-4ab0-9e71-4f50a0c917d6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.153057 Jun 15 10:58:38.058377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2020/3936] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:37 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:38.065828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:38.066473 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:38.072952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:38.073430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:38.074193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:38.074625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:38.135711 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:38.144281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d2e388b3-19bb-4b5e-b4dc-b7081ff7f808 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.082184 Jun 15 10:58:38.144861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1917/3937] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:38 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:39.075181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:39.075830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:39.083674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:39.084119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:39.084889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:39.085354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:39.161322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:39.161945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:39.168740 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:39.169229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:39.170007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:39.170445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:39.222498 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:39.230756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a4aab7ad-ffd6-4488-88fc-45189cf7ab92 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159399 Jun 15 10:58:39.231340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2021/3938] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:39.237847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:39.245884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-df81e808-3638-4e56-9d13-7c86aaf646e0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.088488 Jun 15 10:58:39.246448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1918/3939] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:39 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:40.249632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:40.250365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:40.257311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:40.257760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:40.258644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:40.259093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:40.263906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:40.264938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:40.272056 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:40.272494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:40.273332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:40.273766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:40.339019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:40.357775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6e41426-264a-403d-b967-630288234e55 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.097903 Jun 15 10:58:40.359120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1919/3940] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:40 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:40.396052 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:40.404433 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9535df01-9dff-41eb-ad71-147a6fdcf632 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159126 Jun 15 10:58:40.405612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2022/3941] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:41.375628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:41.376275 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:41.383033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:41.398282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:41.398282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:41.398282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:41.422439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:41.423043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:41.429904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:41.430505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:41.431170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:41.431631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:41.455639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:41.463813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2cb42b28-fd5c-4db8-88ba-219b87c89540 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.092517 Jun 15 10:58:41.464583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1920/3942] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:41 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:41.571242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:41.574746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:41.580266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3310ce3a-7880-4ab5-a9e3-53f32db3e2ce tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.162400 Jun 15 10:58:41.580842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2023/3943] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:42.481520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:42.482140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:42.489440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:42.489883 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:42.490639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:42.491066 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:42.556051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:42.564936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-546ab835-0414-4dcf-997a-28a7659b7468 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087239 Jun 15 10:58:42.565540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1921/3944] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:42 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:42.598269 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:42.598860 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:42.605737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:42.606177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:42.606937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:42.607364 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:42.743011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:42.753415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8e7796cc-04bf-4540-9e38-3937134cdedf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159700 Jun 15 10:58:42.754006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2024/3945] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:43.581356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:43.581976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:43.588631 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:43.589124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:43.589895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:43.590336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:43.660826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:43.669260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-744d7d8c-6602-4893-ac2f-4cfe59cfcf65 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.091617 Jun 15 10:58:43.669839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1922/3946] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:43 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:43.771501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:43.772112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:43.779280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:43.779722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:43.781160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:43.781602 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:43.931716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:43.937219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-73ee5c6f-e22a-4b7d-b2b0-e2ef75d111a4 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.169557 Jun 15 10:58:43.937801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2025/3947] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:43 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:44.687864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:44.688519 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:44.695153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:44.695606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:44.696365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:44.696801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:44.758299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:44.766622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f22a0230-5339-49ce-8fae-3cc1b182c05d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083636 Jun 15 10:58:44.767190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1923/3948] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:44 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:44.957698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:44.958311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:44.964517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:44.964997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:44.965762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:44.966195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:45.106203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:45.117079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-295675aa-98b5-4513-92fd-4b7158844754 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.163345 Jun 15 10:58:45.117783 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2026/3949] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:45.783733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:45.784388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:45.790975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:45.791420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:45.792174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:45.792603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:45.925196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:45.933375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bb29bedb-9bec-4c62-94bf-35f9eea348e7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.153696 Jun 15 10:58:45.933966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1924/3950] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:45 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:46.133594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:46.134151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:46.141817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:46.142261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:46.143030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:46.143452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:46.284681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:46.293233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-edf05b71-3345-4549-bd9e-f368d74bdf7d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.163423 Jun 15 10:58:46.293813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2027/3951] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:46 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:46.951790 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:46.952506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:46.959731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:46.960171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:46.960945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:46.961405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:47.026299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:47.035292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-34b2b73d-ceac-49a7-b5d9-6bcc3958dabf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087516 Jun 15 10:58:47.035873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1925/3952] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:46 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:47.311080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:47.311926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:47.319086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:47.319528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:47.320290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:47.320717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:47.513436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:47.523300 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8f9ac7bb-fd75-4a93-9c56-48f1aaf8a3a3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.215934 Jun 15 10:58:47.524149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2028/3953] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:47 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:48.052176 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:48.052888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:48.059582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:48.060033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:48.060820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:48.061286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:48.131091 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:48.139241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ac8e983-83a8-43cb-b665-a66fc8702cd4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.090911 Jun 15 10:58:48.139926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1926/3954] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:48 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:48.542339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:48.542951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:48.549948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:48.550387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:48.551134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:48.551562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:48.685760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:48.694053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e87cbb21-dfb4-4070-a39e-8dffbd742d6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155634 Jun 15 10:58:48.694622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2029/3955] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:48 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:49.156836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:49.157651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:49.164392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:49.164828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:49.165634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:49.166086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:49.230124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:49.238560 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-00265f07-8aea-4fdc-8f91-d08f712d8012 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087042 Jun 15 10:58:49.239128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1927/3956] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:49 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:49.710983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:49.711665 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:49.719188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:49.719634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:49.720464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:49.720843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:49.855939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:49.864270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e49cc381-5eec-4881-8c3f-f2ac4da81b6d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157160 Jun 15 10:58:49.864835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2030/3957] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:49 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:50.256526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:50.257169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:50.263745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:50.264185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:50.265764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:50.266206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:50.284639 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:50.331659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:50.338610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a81d3bc-cb2b-47c5-b7fd-9a0b0f59eddd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085810 Jun 15 10:58:50.339202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1928/3958] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:50 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:50.881794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:50.882356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:50.889103 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:50.889553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:50.890354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:50.890792 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:51.023569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:51.032054 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-71eab36c-7e75-47d7-b48b-1ae022b3c695 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154676 Jun 15 10:58:51.032618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2031/3959] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:50 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:51.356073 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:51.356675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:51.364269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:51.364709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:51.365626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:51.366061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:51.430432 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:51.438951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0d00c0fa-dc9a-4c7b-a3d4-2940a4e2e71c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086705 Jun 15 10:58:51.439535 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1929/3960] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:51 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:52.049893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:52.050580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:52.057222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:52.057666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:52.058427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:52.058861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:52.192535 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:52.200786 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b15d1282-b2ab-46fa-ad2a-942427a6017b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155452 Jun 15 10:58:52.201372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2032/3961] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:52 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:52.459020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:52.459777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:52.466559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:52.467000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:52.467753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:52.470028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:52.537696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:52.546738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8047f116-a830-4486-bf09-51049654a205 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.090895 Jun 15 10:58:52.547667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1930/3962] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:52 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:53.220286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:53.220896 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:53.227765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:53.228203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:53.228973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:53.229410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:53.365012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:53.373261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a303030a-a048-475c-8195-a17770d06e15 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157362 Jun 15 10:58:53.373843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2033/3963] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:53 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:53.564794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:53.565431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:53.572099 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:53.572542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:53.573343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:53.573771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:53.639002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:53.648101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6f586d18-8b41-40b4-9b04-adccfc8f0918 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.088269 Jun 15 10:58:53.648673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1931/3964] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:53 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:54.392076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:54.393056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:54.402650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:54.403092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:54.403864 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:54.404305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:54.536273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:54.544559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4ba556b6-ba76-4dab-b71c-307ee91910aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157247 Jun 15 10:58:54.545463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2034/3965] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:54 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:54.665306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:54.665863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:54.672185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:54.672622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:54.673405 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:54.673836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:54.736126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:54.744505 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1fc6f65c-35bd-408c-a312-fc7b985e589b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083170 Jun 15 10:58:54.745114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1932/3966] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:54 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:55.563123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:55.563747 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:55.571124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:55.571562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:55.572330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:55.572761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:55.722324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:55.729169 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-29843a79-e24a-4075-80de-271aaa670283 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.169932 Jun 15 10:58:55.729750 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2035/3967] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:55 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:55.762353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:55.762996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:55.770758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:55.771201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:55.771980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:55.772468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:55.852434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:55.867103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b36ffa76-7f97-4bd8-b44d-d62e8e160232 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.108151 Jun 15 10:58:55.868167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1933/3968] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:55 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:56.746848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:56.747448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:56.754928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:56.755691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:56.756506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:56.756941 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:56.892358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:56.893152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:56.899888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:56.900062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:56.900339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:56.901171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:56.901611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:56.908929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92e52a06-973f-4a7e-9b50-d925cccef905 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.165804 Jun 15 10:58:56.911296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2036/3969] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:56 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:56.968434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:56.977257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-76b8b7fa-7375-40f9-93af-44c460cbc7ff tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.089452 Jun 15 10:58:56.977820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1934/3970] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:56 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:57.928442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:57.929086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:57.931587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=52 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:57.936557 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:57.937063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:57.937830 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:57.938259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:57.993840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:57.994442 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:58.001856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:58.002306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:58.003080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:58.003516 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:58.066292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:58.074008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:58.074427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b703f940-5935-4288-a0ec-cb1603da2e8c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084488 Jun 15 10:58:58.075007 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1935/3971] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:57 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:58:58.083117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3b332192-bdaf-488e-915c-e5583ceeb0cf tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159518 Jun 15 10:58:58.083719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2037/3972] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:57 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:59.092374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:59.093529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:59.097131 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=56 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:58:59.100429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:58:59.100945 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:59.101084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:58:59.101372 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:59.102144 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:59.102581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:59.107724 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:59.115267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:59.115267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:58:59.115267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:58:59.165997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:59.175638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7c76b70c-49ff-4dcb-9585-7fba3846a782 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087078 Jun 15 10:58:59.176225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1936/3973] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:59 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:58:59.244842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:58:59.253779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9a5a52ce-75a1-4a58-b89f-fc1142a58166 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157442 Jun 15 10:58:59.254348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2038/3974] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:58:59 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:00.192180 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:00.192782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:00.199363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:00.199849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:00.200628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:00.201104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:00.264339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:00.271347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:00.272156 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:00.273614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9236fab5-83dc-41dd-a646-72b1c6a8eeb3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085233 Jun 15 10:59:00.274256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1937/3975] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:00 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:00.278882 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:00.279323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:00.280093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:00.280531 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:00.414656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:00.423180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d326b868-5824-4700-ac50-4091ea3c16a9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155549 Jun 15 10:59:00.423758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2039/3976] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:00 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:01.291699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:01.292321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:01.299646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:01.300092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:01.300853 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:01.301323 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:01.366481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:01.374739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-61723bfd-5391-4031-8975-b710e97b6de6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086872 Jun 15 10:59:01.375406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1938/3977] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:01 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:01.441028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:01.441635 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:01.448193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:01.448633 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:01.449421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:01.449858 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:01.468303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:01.595983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:01.604314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1e99e04-170a-481c-b8a2-524a4bf22769 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.167480 Jun 15 10:59:01.604920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2040/3978] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:01 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:02.391727 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:02.392429 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:02.398987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:02.399435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:02.400201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:02.400632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:02.462843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:02.471565 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1df6c13-e113-4606-8838-7457436199c2 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083869 Jun 15 10:59:02.472140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1939/3979] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:02 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:02.622677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:02.623312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:02.630838 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:02.631285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:02.632076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:02.632515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:02.768055 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:02.776285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-99db5e6c-4f0d-419f-a96f-166d75aec6af tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157473 Jun 15 10:59:02.776893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2041/3980] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:02 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:03.489612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:03.490259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:03.497465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:03.497922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:03.498722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:03.499165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:03.564646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:03.573045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f51fc7a3-ebda-454d-8674-1a003a014e45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087990 Jun 15 10:59:03.574017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1940/3981] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:03 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:03.794356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:03.794926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:03.801718 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:03.802162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:03.802932 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:03.803358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:03.936746 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:03.945549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a04c6605-372e-4c06-9a18-ffd8dabf84c9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155129 Jun 15 10:59:03.946120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2042/3982] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:03 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:04.591218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:04.591826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:04.599643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:04.600083 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:04.600839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:04.601289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:04.663094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:04.671348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b3190ac8-92b5-423b-9943-0dbb9818b48b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.083901 Jun 15 10:59:04.672078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1941/3983] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:04 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:04.962905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:04.963508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:04.970768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:04.971221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:04.971988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:04.972426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:05.111807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:05.120487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52f506f8-7fdf-4f29-a331-a205d13bcd46 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.161404 Jun 15 10:59:05.121118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2043/3984] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:04 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:05.688273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:05.689011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:05.695660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:05.696104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:05.696864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:05.697316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:05.763003 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:05.771228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-696c02e7-f35f-41c0-8bc7-1de498904cf0 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086788 Jun 15 10:59:05.771829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1942/3985] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:05 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:06.138694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:06.139331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:06.146990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:06.147439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:06.148219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:06.148651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:06.285908 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:06.293992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-92d492d1-b921-4683-9271-85d52a7740aa tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.159116 Jun 15 10:59:06.294594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2044/3986] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:06 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:06.788043 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:06.788642 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:06.795869 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:06.796885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:06.797674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:06.798128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:06.861539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:06.869694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4c12b63a-49d1-4671-8eec-f62150a50751 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085560 Jun 15 10:59:06.870262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1943/3987] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:06 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:07.310996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:07.311634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:07.318343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:07.318794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:07.319549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:07.319983 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:07.454150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:07.462114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2104d07d-f0ca-41b6-bcff-3f6b6d8df757 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.154981 Jun 15 10:59:07.462676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2045/3988] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:07 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:07.887293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:07.887840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:07.895332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:07.895771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:07.896524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:07.896952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:07.957608 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:07.965471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f6eb377e-f37f-4682-95dd-648656b37f58 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.082132 Jun 15 10:59:07.966031 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1944/3989] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:07 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:08.480215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:08.480813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:08.488753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:08.489231 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:08.489995 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:08.490434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:08.634614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:08.643026 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-766e974a-fc0a-45dc-b170-9a75aee152c8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.166758 Jun 15 10:59:08.643608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2046/3990] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:08 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:08.982717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:08.983329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:08.990489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:08.990936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:08.991717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:08.992152 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:08.996403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:09.054687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:09.063080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aa54c53b-ad5d-48d9-9948-dfd9af8f2457 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084108 Jun 15 10:59:09.063668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1945/3991] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:08 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:09.661041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:09.661688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:09.667712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:09.668150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:09.668907 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:09.669358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:09.799720 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:09.807821 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8a4d442d-a39c-4347-b0ac-9d229cbda31d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.151821 Jun 15 10:59:09.808389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2047/3992] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:09 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:10.080807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:10.081510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:10.087953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:10.088397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:10.089194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:10.089632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:10.157554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:10.165537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20b8e89f-cbbe-453e-a7c7-0540e0c54d37 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.089996 Jun 15 10:59:10.166098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1946/3993] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:10 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:10.827273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:10.828443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:10.835119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:10.835564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:10.836329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:10.836763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:10.971105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:10.979308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-83306943-57f0-4f91-a7a6-4408f474adc3 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.155954 Jun 15 10:59:10.979877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2048/3994] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:10 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:11.182686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:11.183260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:11.191744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:11.192187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:11.192944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:11.193398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:11.255992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:11.264331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee669c8e-b096-4f1b-8e2e-5dae107770bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085504 Jun 15 10:59:11.265122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1947/3995] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:11 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:11.996366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:11.997003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:12.004104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:12.004553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:12.005354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:12.005791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:12.139890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:12.148710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2223dbb9-ca2c-45d0-b992-5515d6798948 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.156210 Jun 15 10:59:12.149306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2049/3996] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:11 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:12.282084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:12.282637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:12.289460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:12.289912 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:12.290684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:12.291120 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:12.353624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:12.361893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0f56e820-8416-4ae4-a355-6d63d9257717 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084039 Jun 15 10:59:12.362480 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1948/3997] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:13.167285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:13.167893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:13.175032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:13.175475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:13.176233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:13.176666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:13.311604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:13.320144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0ead28fb-ea6e-44b9-801d-e999dfa54357 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.156690 Jun 15 10:59:13.320695 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2050/3998] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:13 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:13.378666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:13.379331 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:13.385897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:13.386287 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:13.387044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:13.387483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:13.449619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:13.458886 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f62099b-8121-4ee3-bee3-0c53f7dce135 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084331 Jun 15 10:59:13.459467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1949/3999] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:13 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:14.338598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:14.339305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:14.345741 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:14.346188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:14.346954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:14.347398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:14.476683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:14.477315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:14.478056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:14.484024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:14.484467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:14.485980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:14.486670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:14.486829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f0e9e823-a60f-47bc-84c8-e66770024d0e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.152140 Jun 15 10:59:14.487410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2051/4000] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:14 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:14.555769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:14.564095 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5a5d9b77-5b8b-4db0-ab6c-c1139634af1d tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.091514 Jun 15 10:59:14.564676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1950/4001] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:14 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:15.505136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:15.505761 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:15.512787 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:15.513273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:15.514134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:15.514524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:15.581581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:15.582319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:15.590697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:15.591157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:15.591980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:15.592401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:15.671142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:15.672866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:15.681259 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36db4396-3e32-4bbe-bf78-9a7b2a5b21b4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.103880 Jun 15 10:59:15.681856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1951/4002] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:15 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:15.682422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-42d5b5f6-b2f0-4dd2-b47b-ee571841600e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.182181 Jun 15 10:59:15.682985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2052/4003] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:15 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:16.699758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:16.700353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:16.707999 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.708467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.709280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.709720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.717034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:16.717755 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:16.725606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.726058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.726897 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.727338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.786859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:16.795439 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-997af6f1-f55b-40d7-965f-07c156bb7654 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.099511 Jun 15 10:59:16.796289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1952/4004] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:16 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:16.875376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:16.884816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-20a6eaed-84e0-44fc-a7c2-6937a093884d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.179193 Jun 15 10:59:16.885444 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2053/4005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:16 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:16.922336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:16.922994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:16.929775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.930220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.931002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:16.931438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:16.959963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-69c60d8a-8de9-4444-81e7-f8af967d4b31 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/ips" status: 200 len: 151 microversion: 2.20 time: 0.041687 Jun 15 10:59:16.960539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1953/4006] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Jun 15 10:59:16 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:59:17.813550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:17.814166 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:17.821018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:17.821461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:17.822230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:17.822672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:17.896540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:17.903563 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:17.904261 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:17.904914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6dfb1ad5-7c45-42b8-b2f1-f201335a9655 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.095529 Jun 15 10:59:17.905525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2054/4007] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:17 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:17.912108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:17.912551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:17.913357 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:17.913789 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:18.052382 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:18.061047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3dae07b7-d79e-4ee9-a5bf-a8af7bc505ac tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.161152 Jun 15 10:59:18.061627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1954/4008] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:17 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:18.923331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:18.924118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:18.930677 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:18.931121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:18.931878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:18.932305 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:18.996660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:19.005576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3edff3b7-f10c-4019-9d9b-df9b643d1074 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086654 Jun 15 10:59:19.006173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2055/4009] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:18 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:19.078682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:19.079566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:19.086947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:19.087399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:19.088171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:19.088914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:19.226416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:19.234877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8ebc692a-a5ab-406b-8b7e-0d27de47bb52 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.160156 Jun 15 10:59:19.236847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1955/4010] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:19 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:20.023082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:20.023691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:20.030422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.030871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.031649 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.032084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.091820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:20.092413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:20.100713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.100866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.101676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.102118 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.103024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:20.111883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cbd53aee-5f46-4671-9a95-110f934b9980 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.092411 Jun 15 10:59:20.112601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2056/4011] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:20 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:20.131624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-56b077fe-d155-43a0-8ac7-4a8372ccc8f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/ips" status: 200 len: 150 microversion: 2.1 time: 0.043623 Jun 15 10:59:20.132196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1956/4012] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 10:59:20 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:20.254006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:20.255449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:20.261034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.261512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.262291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:20.262732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:20.267991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:20.406550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:20.415763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-976b2c9d-7572-481f-8273-542553ac5019 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.166050 Jun 15 10:59:20.416321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2057/4013] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:20 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:21.130550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:21.131198 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:21.137752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:21.138197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:21.138954 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:21.139390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:21.202486 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:21.211754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-96ef9d00-6bcb-49fc-bb56-bec1adf4d078 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085749 Jun 15 10:59:21.212330 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1957/4014] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:21 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:21.433314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:21.433874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:21.440982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:21.441427 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:21.442198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:21.442632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:21.590042 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:21.599939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fcaaffd0-d646-4fc1-934d-0f7a6b4bc1e7 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.170529 Jun 15 10:59:21.600529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2058/4015] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:21 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:22.229619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:22.230219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:22.236806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:22.237291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:22.238050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:22.238483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:22.312106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:22.327769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1e2703e9-fc73-4a86-8cff-28f494df71a3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.101621 Jun 15 10:59:22.328879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1958/4016] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:22 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:22.617982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:22.618584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:22.625445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:22.625881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:22.626928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:22.627656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:22.770291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:22.780108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7b0dcb8a-b504-4534-b556-a0ae826a52d8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.165875 Jun 15 10:59:22.780692 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2059/4017] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:22 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:23.346864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:23.347474 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:23.354521 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:23.354966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:23.355769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:23.356196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:23.420308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:23.429268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-05d0a62f-5f3d-49c5-8e9d-c96368597d08 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.086694 Jun 15 10:59:23.429896 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1959/4018] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:23 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:23.798617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:23.799482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:23.806494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:23.807353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:23.807802 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:23.808220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:23.947314 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:23.958301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bd92d45e-8c0d-4b43-ae8a-d4952411e59f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.163795 Jun 15 10:59:23.958910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2060/4019] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:23 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:24.446133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:24.446791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:24.453602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:24.454089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:24.455488 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:24.456175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:24.530527 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:24.540682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-63f99114-3b52-42c7-b4c4-817d296132bf tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.098599 Jun 15 10:59:24.541490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1960/4020] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:24 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:24.976323 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:24.976931 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:24.983873 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:24.984309 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:24.985104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:24.985542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:25.149461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:25.158505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f9372d8-40b6-41b4-a416-6c52a82e70e8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.186347 Jun 15 10:59:25.159081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2061/4021] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:24 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:25.558996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:25.559613 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:25.566761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:25.567216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:25.567986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:25.568425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:25.631011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:25.639141 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7b7ff9f-f23e-4e0a-a7d1-347ab156667c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.084159 Jun 15 10:59:25.639704 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1961/4022] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:25 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:26.176227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:26.176819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:26.183646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:26.184031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:26.184868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:26.185334 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:26.316723 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:26.324729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-056c738d-7878-4936-8684-bd1d56b637db tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.152959 Jun 15 10:59:26.325336 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2062/4023] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:26 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:26.655953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:26.656570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:26.663998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:26.664443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:26.665226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:26.665663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:26.684717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:26.731101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:26.739955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bc0a488d-a905-41b6-b50b-2b3916d1060f tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.087843 Jun 15 10:59:26.740451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1962/4024] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:26 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:27.342473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:27.343069 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:27.351174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:27.351619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:27.352378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:27.352801 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:27.492356 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:27.500668 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2888d2a2-ce9d-4508-8c63-8494d811ed22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.162186 Jun 15 10:59:27.501287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2063/4025] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:27 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:27.757788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:27.758410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:27.767630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:27.773353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:27.773353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:27.773353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:27.836577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:27.844771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b6e0c679-741f-4a82-bdfc-ba20c90d7f16 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.091608 Jun 15 10:59:27.846626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1963/4026] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:27 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:28.517895 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:28.518503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:28.520866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=54 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:28.525706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:28.526151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:28.526918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:28.527353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:28.669956 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:28.679763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-df2708a8-d052-43eb-9504-d36e3acbe86e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.165651 Jun 15 10:59:28.680619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2064/4027] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:28 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:28.864035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:28.864679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:28.871353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:28.882383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:28.882383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:28.882383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:28.935855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:28.944730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-08b7cd4e-89dc-4740-94b2-8136b7753993 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1367 microversion: 2.1 time: 0.085479 Jun 15 10:59:28.945324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1964/4028] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:28 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:29.697743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:29.698329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:29.705636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:29.706086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:29.706842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:29.707273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:29.842100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:29.851331 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ff65b94-36f3-48f8-9e39-55dcc5a15d7e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.157325 Jun 15 10:59:29.851828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2065/4029] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:29 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:29.962085 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:29.962758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:29.965014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=58 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:29.969783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:29.971441 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:29.972218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:29.972661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:30.005449 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:30.005888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:30.006333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lazy-loading 'fault' on Instance uuid 7b3a5478-7be1-4af4-913f-48a2c5ee7199 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:30.048156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:30.056481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98957d7f-9b1c-413b-b418-54e75d413fee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 200 len: 1461 microversion: 2.1 time: 0.098346 Jun 15 10:59:30.057077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1965/4030] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:29 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:30.869580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:30.870230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:30.877415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:30.877851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:30.878631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:30.879071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:31.024939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:31.034263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1a5bfc6d-3ed5-47f2-88ea-07128f14fdbe tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.168732 Jun 15 10:59:31.034974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2066/4031] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:30 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:31.074184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:31.074890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:31.082492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:31.082941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:31.083742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:31.084181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:31.098392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 HTTP/1.1 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:59:31.100317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 10:59:31.102200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '7b3a5478-7be1-4af4-913f-48a2c5ee7199'} Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:59:31.103313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 10:59:31.105186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:31.106879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:59:31.106879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0aa7c87c-5ab3-421a-97cd-36fd39bf8961 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 404 len: 111 microversion: 2.1 time: 0.031834 Jun 15 10:59:31.106879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1966/4032] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:31 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:59:31.111512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6627648e-9d3e-4fc5-95ef-8b1af9b8a1f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '.version_select at 0x7fc279592a60>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:31.198628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6627648e-9d3e-4fc5-95ef-8b1af9b8a1f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717233124" status: 202 len: 0 microversion: 2.1 time: 0.086580 Jun 15 10:59:31.198628 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2067/4033] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Jun 15 10:59:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717233124 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:59:31.296291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-0ade24de-99c3-43c5-b24a-0b21b1b63452 req-6a676a7e-674f-4e36-85d0-117de0382cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4944d55-b710-413e-81ed-24e682fa5479", "name": "network-vif-deleted", "tag": "27e773d4-aed6-4a80-bac1-bbb3f07bf3e2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:31.305829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0ade24de-99c3-43c5-b24a-0b21b1b63452 req-6a676a7e-674f-4e36-85d0-117de0382cf4 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:31.306272 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0ade24de-99c3-43c5-b24a-0b21b1b63452 req-6a676a7e-674f-4e36-85d0-117de0382cf4 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:31.320103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-0ade24de-99c3-43c5-b24a-0b21b1b63452 req-6a676a7e-674f-4e36-85d0-117de0382cf4 service nova] Creating event network-vif-deleted:27e773d4-aed6-4a80-bac1-bbb3f07bf3e2 for instance c4944d55-b710-413e-81ed-24e682fa5479 on hv-cinder-84580 Jun 15 10:59:31.325626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-0ade24de-99c3-43c5-b24a-0b21b1b63452 req-6a676a7e-674f-4e36-85d0-117de0382cf4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086536 Jun 15 10:59:31.326220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1967/4034] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:31.963859 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:31.964502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:31.971924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:31.972515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:31.973324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:31.973762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:32.000246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lazy-loading 'flavor' on Instance uuid 4e5ab828-46b7-44de-9577-8ddfb3385803 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:32.052291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:32.053229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:32.060269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:32.061001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:32.061826 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:32.062315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:32.239077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:32.247728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6b886c23-fcb4-4143-83f2-0ba0fe878a59 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.199580 Jun 15 10:59:32.248276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1968/4035] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:32 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:32.254034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97c09156-af09-471d-b8d7-247bf89c31a8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: .version_select at 0x7fc27a02bc10>, body: {"keypair": {"name": "tempest-keypair-307745814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkPxuTIQlX7ZY2dBLy2sgVDoh74Wm/6w54uw+AJHcXchmcCKDQi040Zij0JRVrxMjH6MZWKq5NaQtKaFGOpP0v12Dj737K+pQekABwEgp0kE8BjRR+FEWZjQ59cjGGTVQ=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:32.268627 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-97c09156-af09-471d-b8d7-247bf89c31a8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for project a09fe8836f914998aec8ee2afcca9e16. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:59:32.272849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-97c09156-af09-471d-b8d7-247bf89c31a8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for user 9f1e192f3eab42ee9f9ed5d2789e0d1e and project a09fe8836f914998aec8ee2afcca9e16. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:59:32.360181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97c09156-af09-471d-b8d7-247bf89c31a8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110643 Jun 15 10:59:32.361022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1969/4036] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 10:59:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:32.484128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1c2bd545-febf-4173-84b5-180f1c216152 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/action" status: 202 len: 0 microversion: 2.20 time: 0.524605 Jun 15 10:59:32.485563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2068/4037] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Jun 15 10:59:31 2022] POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:59:32.493301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:32.493915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:32.500121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:32.500569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:32.501890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:32.502364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:32.653786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:32.663320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:32.668324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:32.668324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b5310d5-5837-4c74-a595-4104399b6d34 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.176746 Jun 15 10:59:32.668324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1970/4038] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:32 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:33.267119 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:33.268547 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:33.274421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:33.274861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:33.275626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:33.276049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:33.440717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:33.449001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-695e09b3-941e-47d4-84e2-0baccd2445b9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.186602 Jun 15 10:59:33.451236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2069/4039] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:33 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:33.684760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:33.685520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:33.692924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:33.693401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:33.694184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:33.694628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:33.843107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:33.857102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:33.858996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:33.860208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-98abb8f2-26d7-4d96-92e0-17fcde4d9274 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.179497 Jun 15 10:59:33.860771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1971/4040] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:33 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:34.465999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:34.466590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:34.474337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:34.475035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:34.475796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:34.476218 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:34.646377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:34.654603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6bf6cc7b-80c8-425e-bc0b-f0d1f4461b81 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.192495 Jun 15 10:59:34.655157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2070/4041] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:34 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:34.880690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:34.881508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:34.888298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:34.888752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:34.889550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:34.890060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:34.963348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-493742575", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11cf7c9e-caa5-4e08-9e83-433282066dfb"}], "security_groups": [{"name": "tempest-securitygroup--1118138235"}], "key_name": "tempest-keypair-307745814", "user_data": "}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:35.050182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:35.062500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:35.064220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:35.066410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-074439a4-b29e-49c6-b6ed-231cf89e27f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.190516 Jun 15 10:59:35.066983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1972/4042] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:34 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:35.075139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.network.neutron [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] validate_networks() for [('11cf7c9e-caa5-4e08-9e83-433282066dfb', None, None, None, None, None)] {{(pid=118121) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:59:35.572182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Flavor limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:59:35.572775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Image limits 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:59:35.573125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Flavor pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:59:35.573534 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Image pref 0:0:0 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:59:35.573971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.virt.hardware [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:59:35.584630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:35.585591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:35.586384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:35.586812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:35.609632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for project a09fe8836f914998aec8ee2afcca9e16. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:59:35.615041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Getting quotas for user 9f1e192f3eab42ee9f9ed5d2789e0d1e and project a09fe8836f914998aec8ee2afcca9e16. Resources: {'cores', 'instances', 'ram'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:59:35.627124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Going to run 1 instances... {{(pid=118121) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:59:35.631410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118121) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:59:35.677364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:35.678393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:35.684206 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:35.684653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:35.685510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:35.685906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:35.771131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5251bb9a-26f5-4ded-871a-c70cd06143b3 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.803237 Jun 15 10:59:35.771131 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2071/4043] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 10:59:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:59:35.774469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0f2e325d-3600-48b3-9bd5-0df40bcf02fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:35.775571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0f2e325d-3600-48b3-9bd5-0df40bcf02fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:35.835982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0f2e325d-3600-48b3-9bd5-0df40bcf02fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:35.847412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0f2e325d-3600-48b3-9bd5-0df40bcf02fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1236 microversion: 2.1 time: 0.077480 Jun 15 10:59:35.848194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2072/4044] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:35 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:35.858975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:35.868305 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-23fb4ac7-514b-4151-9e11-2f7a66453afd tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.195549 Jun 15 10:59:35.868995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1973/4045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:35 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:36.084737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:36.085360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:36.092189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.092634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.093426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.093854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.242411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:36.251449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:36.254280 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:36.255464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7f68aec2-8b02-492f-be12-cdd6c7221b59 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.175702 Jun 15 10:59:36.256016 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2073/4046] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:36 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:36.833823 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333bbd52-9afd-45ed-82a4-1aca416830ee"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:36.834887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:36.841791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.842132 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.842906 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.843337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.869494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:36.870744 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:36.883556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.883997 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.885360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.886104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.905870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:36.954284 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:36.962375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee0a2e03-d34f-4722-8521-b36e0ace7550 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1240 microversion: 2.1 time: 0.097332 Jun 15 10:59:36.962946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2074/4047] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:36 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:36.974132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:36.974132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:36.975879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.976322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:36.977114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:36.977580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:37.115666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:37.124140 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4afacc20-a5db-4151-b52a-fb90a59cf925 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1733 microversion: 2.1 time: 0.160098 Jun 15 10:59:37.124889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2075/4048] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:36 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:37.337954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:37.338567 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:37.352497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:37.352947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:37.353743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:37.354171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:37.738919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:37.749833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:37.751255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:37.753894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-07884a8d-ec27-4358-9702-e8c38dda4f53 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.484080 Jun 15 10:59:37.754556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2076/4049] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:37 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:37.982222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:37.983586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:37.990975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:37.991420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:37.992208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:37.992672 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:38.069040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:38.077416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4bf44aef-94be-4c9a-8763-dc244ed74bf7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1232 microversion: 2.1 time: 0.098935 Jun 15 10:59:38.078015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2077/4050] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:37 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1232 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:38.113862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a22e859d-f37f-4372-9cf0-d0c761964cbf tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.284738 Jun 15 10:59:38.114799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1974/4051] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:59:36 2022] POST /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 194 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:38.143524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:38.144180 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:38.150667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:38.151106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:38.151871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:38.152492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:38.304076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:38.312389 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2b64329e-4020-4101-9cdc-5e46e90275e6 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1687 microversion: 2.1 time: 0.173693 Jun 15 10:59:38.313008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2078/4052] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:38 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:38.774499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:38.775207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:38.782170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:38.782616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:38.784365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:38.784705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:38.924503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:38.932663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:38.934158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:38.935318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c5437f1-eca4-4a3f-954f-609af01b4185 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.165712 Jun 15 10:59:38.935947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1975/4053] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:38 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:39.096730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:39.100341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:39.105447 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.105889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:39.106652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.107080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:39.172401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:39.180176 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5db6c053-8a5e-40d8-bb52-c38cfade86b8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1296 microversion: 2.1 time: 0.089171 Jun 15 10:59:39.180745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2079/4054] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:39 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:39.329568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:39.330292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:39.337104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.340285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:39.340285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.340285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:39.474167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:39.482154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94820de3-9b10-4084-8c4b-f726f8196674 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1687 microversion: 2.1 time: 0.156424 Jun 15 10:59:39.482726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1976/4055] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:39 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:39.953890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:39.954554 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:39.962378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.962759 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:39.963529 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:39.963965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:40.113885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:40.125492 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:40.127292 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:40.130397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-28b94ec8-ab51-4908-9f53-fce4a692ef82 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.179451 Jun 15 10:59:40.133644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2080/4056] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:39 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:40.198286 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:40.198901 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:40.206256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:40.206784 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:40.207662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:40.208114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:40.321756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:40.330367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29dd21b3-1daf-4fcb-96e3-995f09cd104c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1294 microversion: 2.1 time: 0.135560 Jun 15 10:59:40.331569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1977/4057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:40 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:40.500046 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:40.500655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:40.507059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:40.507505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:40.508272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:40.508713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:40.665098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:40.674532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-51a903f8-04c8-4a2b-8f87-c50bc381f07a tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1687 microversion: 2.1 time: 0.178465 Jun 15 10:59:40.675442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2081/4058] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:40 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:41.152248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:41.153333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:41.167426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.167874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.171019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.172104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.349710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:41.350753 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:41.366322 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.366779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.367581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.368021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.617610 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:41.627514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:41.640255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:41.648745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:41.650247 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-282ae89d-bf80-48b7-8c2a-88ea10df9628 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.505546 Jun 15 10:59:41.651763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1b80486-175a-4913-9c50-9a4c34e4f8ed tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.307961 Jun 15 10:59:41.652445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1978/4059] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:41 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:41.655559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2082/4060] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:41 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:41.667846 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-f452a169-d863-4509-a1b8-873377947562 req-22859bd8-d9fc-4ffc-974d-52852ee01e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b906bc-e412-4bce-b195-2d23d466072d", "name": "network-vif-deleted", "tag": "2ff2b02f-44a2-40a9-a924-56872e3fd21c"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:41.681564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-f452a169-d863-4509-a1b8-873377947562 req-22859bd8-d9fc-4ffc-974d-52852ee01e89 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.681949 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-f452a169-d863-4509-a1b8-873377947562 req-22859bd8-d9fc-4ffc-974d-52852ee01e89 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.692709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:41.693575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:41.701384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.701840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.702862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.703308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.713717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-f452a169-d863-4509-a1b8-873377947562 req-22859bd8-d9fc-4ffc-974d-52852ee01e89 service nova] Creating event network-vif-deleted:2ff2b02f-44a2-40a9-a924-56872e3fd21c for instance d3b906bc-e412-4bce-b195-2d23d466072d on hv-cinder-84580 Jun 15 10:59:41.723866 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-f452a169-d863-4509-a1b8-873377947562 req-22859bd8-d9fc-4ffc-974d-52852ee01e89 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068442 Jun 15 10:59:41.733093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1979/4061] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:41.851379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:41.870511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-079b5dba-b1ff-43d2-a1aa-1c5877d13b01 req-b178883c-c581-4421-84cb-be6fd7d46ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7caeb5-c9cc-493c-94d7-cac63be29ff2", "name": "network-vif-deleted", "tag": "3f207246-b0bf-4941-9c5b-903c2361d2dc"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:41.876518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-96fdd7de-7be2-4296-862c-e7c4463bafe8 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1330 microversion: 2.1 time: 0.187719 Jun 15 10:59:41.877563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2083/4062] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:41 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1330 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:41.890966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-079b5dba-b1ff-43d2-a1aa-1c5877d13b01 req-b178883c-c581-4421-84cb-be6fd7d46ef6 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:41.891626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-079b5dba-b1ff-43d2-a1aa-1c5877d13b01 req-b178883c-c581-4421-84cb-be6fd7d46ef6 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:41.904025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-079b5dba-b1ff-43d2-a1aa-1c5877d13b01 req-b178883c-c581-4421-84cb-be6fd7d46ef6 service nova] Creating event network-vif-deleted:3f207246-b0bf-4941-9c5b-903c2361d2dc for instance 3c7caeb5-c9cc-493c-94d7-cac63be29ff2 on hv-cinder-84580 Jun 15 10:59:41.910061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-079b5dba-b1ff-43d2-a1aa-1c5877d13b01 req-b178883c-c581-4421-84cb-be6fd7d46ef6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Jun 15 10:59:41.911483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1980/4063] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:59:42.669963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:42.672216 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:42.672824 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:42.677660 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:42.678391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:42.685916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.686695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.686855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.687618 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.687982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.688425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.689426 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.690917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.700178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:42.874694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:42.879476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:42.888004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:42.889583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4bf7a319-9c1f-48cd-9d7e-188fc0df4227 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.219125 Jun 15 10:59:42.890302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1981/4064] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:42 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:42.892852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:42.894673 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f08a18dc-00aa-42ce-a32e-d31b8f4e5c4f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.226788 Jun 15 10:59:42.895775 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2084/4065] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:42 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:42.903027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:42.906088 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:42.913006 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.914195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.915181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.915818 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.954467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:42.954977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:42.957384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'fault' on Instance uuid d3b906bc-e412-4bce-b195-2d23d466072d {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:43.001194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:43.010203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-586137b0-ea0f-47bd-8499-3857d862ae19 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 200 len: 1335 microversion: 2.1 time: 0.118576 Jun 15 10:59:43.010898 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1982/4066] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:42 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:43.766515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-d44a9586-ee6e-436c-b697-0fb802b28990 req-b939d23d-da55-4a38-a607-7fa313087da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fd31d8-1234-4075-9891-1faa8ada2e34", "tag": "90fed5d8-e631-42fe-a73d-bac99b65542b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:43.775982 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d44a9586-ee6e-436c-b697-0fb802b28990 req-b939d23d-da55-4a38-a607-7fa313087da8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:43.776422 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-d44a9586-ee6e-436c-b697-0fb802b28990 req-b939d23d-da55-4a38-a607-7fa313087da8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:43.788164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-d44a9586-ee6e-436c-b697-0fb802b28990 req-b939d23d-da55-4a38-a607-7fa313087da8 service nova] Creating event network-changed:90fed5d8-e631-42fe-a73d-bac99b65542b for instance 21fd31d8-1234-4075-9891-1faa8ada2e34 on hv-cinder-84580 Jun 15 10:59:43.793404 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-d44a9586-ee6e-436c-b697-0fb802b28990 req-b939d23d-da55-4a38-a607-7fa313087da8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030501 Jun 15 10:59:43.794012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2085/4067] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:59:43.908427 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:43.910184 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:43.915525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:43.916285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:43.923261 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:43.924040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:43.924191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:43.924506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:43.925582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:43.926058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:43.926497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:43.926936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:44.073466 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:44.077445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:44.082832 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:44.084911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:44.086230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fe13850a-401b-400e-a242-d8fee4ae1e75 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.177544 Jun 15 10:59:44.086526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9eb5b89c-cca2-4c35-9585-020c550a90cd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.183054 Jun 15 10:59:44.087063 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2086/4068] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:43 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:44.087663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1983/4069] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:43 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:44.091713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:44.092478 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: d3b906bc-e412-4bce-b195-2d23d466072d] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:44.099369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:44.100287 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:44.100986 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:44.101423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:44.118612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d HTTP/1.1 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:59:44.120281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. Jun 15 10:59:44.122097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': 'd3b906bc-e412-4bce-b195-2d23d466072d'} Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:59:44.123179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. Jun 15 10:59:44.124685 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:44.126185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 404 to user: Instance d3b906bc-e412-4bce-b195-2d23d466072d could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:59:44.126185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4a18d8bc-1817-4c33-b55f-f4054ee2e39d tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d" status: 404 len: 111 microversion: 2.1 time: 0.033722 Jun 15 10:59:44.126185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2087/4070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:44 2022] GET /compute/v2.1/servers/d3b906bc-e412-4bce-b195-2d23d466072d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:59:44.132029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a3900f86-186c-4b9b-bed8-9a6aa73e9f22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '.version_select at 0x7fc27decf820>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:44.211029 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a3900f86-186c-4b9b-bed8-9a6aa73e9f22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687625558" status: 202 len: 0 microversion: 2.1 time: 0.083588 Jun 15 10:59:44.211926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1984/4071] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Jun 15 10:59:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687625558 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:59:45.104187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:45.104840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:45.107348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:45.107996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:45.112136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:45.112434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:45.113401 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:45.113842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:45.114154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:45.114765 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:45.115520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:45.115950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:45.265552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:45.265734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:45.273999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b745bf05-3de2-4db7-ae27-d60ad788ef82 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.174112 Jun 15 10:59:45.274573 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2088/4072] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:45 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:45.276216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:45.277821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:45.278988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b210b4b2-cf1f-44d9-9ccb-85c1b7ad5afb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.176162 Jun 15 10:59:45.279593 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1985/4073] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:45 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:46.291030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:46.291636 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:46.293855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:46.294731 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:46.297309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:46.297923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:46.300220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:46.300664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:46.301455 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:46.301886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:46.304827 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:46.305378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:46.310492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:46.310492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:46.442384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:46.444981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:46.450149 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3b5e49dc-e684-4a0d-ab4a-b49353ce24bd tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.162903 Jun 15 10:59:46.450725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2089/4074] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:46 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:46.453529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:46.454959 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:46.456769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d3f07660-a6d2-4046-9d16-4b81d937437c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.163767 Jun 15 10:59:46.457356 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1986/4075] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:46 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:47.467922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:47.468533 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:47.476047 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:47.476617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:47.476736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:47.477095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:47.477862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:47.478295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:47.483494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:47.483951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:47.484716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:47.485257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:47.637617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:47.649549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fde51394-4796-4ab5-9f9e-6487ff5dd657 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.185226 Jun 15 10:59:47.657496 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:47.657671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2090/4076] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:47 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:47.659223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:47.660736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:47.661941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fd9f71a9-851a-4693-b52a-8121e5247415 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.191040 Jun 15 10:59:47.662500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1987/4077] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:47 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:48.671614 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:48.672349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:48.679691 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:48.680136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:48.680885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:48.681335 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:48.681739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:48.682353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:48.688522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:48.688987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:48.689754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:48.690750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:48.817727 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:48.826799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67295841-5aba-42dc-8137-bc2d9c9b98db tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.158957 Jun 15 10:59:48.827622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2091/4078] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:48 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:48.837158 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:48.845048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:48.846862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:48.847820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-319ca056-ad28-4128-b393-3037790a33d8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.170040 Jun 15 10:59:48.848401 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1988/4079] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:48 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:49.844383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:49.845014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:49.852512 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:49.852947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:49.853812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:49.854242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:49.867089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:49.867795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:49.873847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:49.874226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:49.874678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:49.875460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:49.875895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:50.005624 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:50.013748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1cd105ad-7522-487e-b9c9-ccd64f55cf92 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.173266 Jun 15 10:59:50.014330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2092/4080] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:49 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:50.021569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:50.026276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:50.027746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:50.029050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5aded4d1-38a0-414b-a979-6eab090323f8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.165963 Jun 15 10:59:50.029605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1989/4081] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:49 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:51.031480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:51.032154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:51.038701 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.039145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.039918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.040352 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.050957 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:51.051871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:51.058911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.063721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.063721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.063721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.178893 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:51.186958 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-855d0baa-98aa-4220-bac9-1abcd518bd49 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.159902 Jun 15 10:59:51.201117 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2093/4082] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:51 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:51.206632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:51.214767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:51.216251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:51.217451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9d65a115-95c7-461e-bbde-e4e1077d948c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.170858 Jun 15 10:59:51.218022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1990/4083] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:51 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:51.801870 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:51.802215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:51.808872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.809472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.810317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:51.810808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:51.840393 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:59:52.095808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-373eeeed-ac2f-4940-bd08-9e13a84d445b tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 204 len: 0 microversion: 2.1 time: 0.298883 Jun 15 10:59:52.097272 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2094/4084] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:59:51 2022] DELETE /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:59:52.105682 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:52.106291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:52.113799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.114237 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.115193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.115620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.204013 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:52.204658 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:52.211486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.211936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.212705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.213532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.246804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:52.255462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3844eb4b-ccb0-45a5-b52d-350bda42abbb tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1505 microversion: 2.1 time: 0.153646 Jun 15 10:59:52.256037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1991/4085] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:52 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:52.260630 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:52.261281 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:52.267795 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.268763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.269596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:52.270036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:52.362321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:52.374417 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2862e747-e335-4649-affe-42b4253b999b tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.174500 Jun 15 10:59:52.374999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2095/4086] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:52 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:52.415825 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:52.424641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:52.427400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:52.427400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-015c4c42-77f5-498f-b6a4-ced9de77d263 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.170387 Jun 15 10:59:52.427890 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1992/4087] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:52 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:53.273373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:53.274091 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:53.280966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.281445 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.282212 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.285182 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.390753 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:53.391397 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:53.399074 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.399514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.400318 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.400746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.427682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:53.435683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7a899373-a9d1-477e-9c29-81c04b347a61 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1505 microversion: 2.1 time: 0.166172 Jun 15 10:59:53.436264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2096/4088] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:53 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:53.447365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:53.448368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:53.454594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.455035 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.457435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:53.458057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:53.548434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:53.556924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-143d44f1-528e-4ab9-a9c0-ca7d7e6298ce tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.170024 Jun 15 10:59:53.557542 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1993/4089] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:53 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:53.603286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:53.611656 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:53.620384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:53.620384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cc905a3f-eae6-4c10-b97d-e72ccea9df0b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1742 microversion: 2.20 time: 0.172919 Jun 15 10:59:53.620384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2097/4090] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:53 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:54.479336 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:54.480859 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:54.511981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.514285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.520849 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.522104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.574822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:54.576057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:54.584045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.585060 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.586038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.586651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.704833 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:54.715845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0beb0c2d-7b3c-4b57-89d4-0744c11d2ed1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1505 microversion: 2.1 time: 0.265015 Jun 15 10:59:54.716974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1994/4091] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:54 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:54.725285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:54.728107 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:54.733677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.734128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.734911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.736089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.845742 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:54.858717 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6de565a1-843b-4cea-8200-cef697c2b425 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.287602 Jun 15 10:59:54.861256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2098/4092] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:54 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:54.921447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:54.932756 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:54.935661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:54.937465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-112c7fa7-1f57-4595-b434-d47d98f358e3 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1742 microversion: 2.20 time: 0.216961 Jun 15 10:59:54.938300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1995/4093] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:54 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:54.960809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-dc11de6f-6802-449d-abf6-e912e1aff510 req-09c4b647-fdc5-4e62-88d4-30698c757d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fd31d8-1234-4075-9891-1faa8ada2e34", "name": "network-vif-plugged", "status": "completed", "tag": "90fed5d8-e631-42fe-a73d-bac99b65542b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:54.969828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-dc11de6f-6802-449d-abf6-e912e1aff510 req-09c4b647-fdc5-4e62-88d4-30698c757d9d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:54.970276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-dc11de6f-6802-449d-abf6-e912e1aff510 req-09c4b647-fdc5-4e62-88d4-30698c757d9d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:54.983041 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-dc11de6f-6802-449d-abf6-e912e1aff510 req-09c4b647-fdc5-4e62-88d4-30698c757d9d service nova] Creating event network-vif-plugged:90fed5d8-e631-42fe-a73d-bac99b65542b for instance 21fd31d8-1234-4075-9891-1faa8ada2e34 on hv-cinder-84580 Jun 15 10:59:54.989298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-dc11de6f-6802-449d-abf6-e912e1aff510 req-09c4b647-fdc5-4e62-88d4-30698c757d9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Jun 15 10:59:54.995432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2099/4094] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:55.252187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-44dc699a-daa4-4b92-bd30-af2938d392f1 req-f7a3dce7-fad7-4ba6-b9ae-c5aa5f4e672e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01adb0d3-da51-4b87-a318-7ec430d8d741", "name": "network-vif-deleted", "tag": "16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:55.277089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-44dc699a-daa4-4b92-bd30-af2938d392f1 req-f7a3dce7-fad7-4ba6-b9ae-c5aa5f4e672e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.281044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-44dc699a-daa4-4b92-bd30-af2938d392f1 req-f7a3dce7-fad7-4ba6-b9ae-c5aa5f4e672e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.315226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-44dc699a-daa4-4b92-bd30-af2938d392f1 req-f7a3dce7-fad7-4ba6-b9ae-c5aa5f4e672e service nova] Creating event network-vif-deleted:16e2e0ab-f9fd-4b82-9469-8c30b1c07ae2 for instance 01adb0d3-da51-4b87-a318-7ec430d8d741 on hv-cinder-84580 Jun 15 10:59:55.333552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333bbd52-9afd-45ed-82a4-1aca416830ee"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:55.334929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.353365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-44dc699a-daa4-4b92-bd30-af2938d392f1 req-f7a3dce7-fad7-4ba6-b9ae-c5aa5f4e672e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108925 Jun 15 10:59:55.354947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1996/4095] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:55.361485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.362384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.363650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.364351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.488139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments HTTP/1.1 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 74 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 10:59:55.490130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volumeAttachment": {"volumeId": "333bbd52-9afd-45ed-82a4-1aca416830ee"}} Jun 15 10:59:55.492186 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'server_id': 'f4151473-56b5-415e-b577-98d34aa05543', 'body': {'volumeAttachment': {'volumeId': '333bbd52-9afd-45ed-82a4-1aca416830ee'}}} Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:55.497036 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:55.499130 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 400 to user: Invalid volume: volume 333bbd52-9afd-45ed-82a4-1aca416830ee is already attached to instances: f4151473-56b5-415e-b577-98d34aa05543 {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f091883a-dd3f-4f90-ae7c-18293bdef0fc tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.172776 Jun 15 10:59:55.500798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2100/4096] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 10:59:55 2022] POST /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:59:55.565582 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:55.566576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.574001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.574483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.575262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.575730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.696229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lazy-loading 'services' on Instance uuid f4151473-56b5-415e-b577-98d34aa05543 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:55.733424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:55.734011 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.736415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:55.742629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.743102 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.743857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.744302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.778735 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.779106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.779560 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'fault' on Instance uuid 01adb0d3-da51-4b87-a318-7ec430d8d741 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:55.825766 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:55.834372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-181678d9-3b1c-4bbf-91bf-7edaa8db73d9 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1311 microversion: 2.1 time: 0.104778 Jun 15 10:59:55.834951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2101/4097] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:55 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:55.877516 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:55.878349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.884568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.884988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.885756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.886277 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.918346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7ee3d428-7cef-4fdb-a66b-cde1ad18f704 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments/333bbd52-9afd-45ed-82a4-1aca416830ee" status: 202 len: 0 microversion: 2.1 time: 0.357529 Jun 15 10:59:55.919046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1997/4098] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 10:59:55 2022] DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments/333bbd52-9afd-45ed-82a4-1aca416830ee => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:59:55.929302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:55.930923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.937961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.938415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.939265 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.939700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.960584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:55.975172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6776af4e-e22d-46e2-b2cc-c22caf5e2357 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051599 Jun 15 10:59:55.976009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1998/4099] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:59:55 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:59:55.980552 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:55.981179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:55.988324 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.990584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:55.990584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:55.990584 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:56.025071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:56.031431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fbc8f0c7-3ab0-4a7c-b698-4eaae87e25de tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.157997 Jun 15 10:59:56.032075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2102/4100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:55 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:56.131104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:56.146625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:56.148124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:56.149603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fa5b3b46-d657-4df9-b16c-1343c66933a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1742 microversion: 2.20 time: 0.172582 Jun 15 10:59:56.150175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 1999/4101] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:55 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:56.855829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:56.856506 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:56.863577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:56.864019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:56.864795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:56.865267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:56.898270 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:56.898721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:56.899172 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'fault' on Instance uuid 01adb0d3-da51-4b87-a318-7ec430d8d741 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:56.943627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:56.951454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-420c25b5-d63f-4cdd-8b85-df03716a5a22 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1311 microversion: 2.1 time: 0.099936 Jun 15 10:59:56.952032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2103/4102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:56 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:56.988212 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:56.989309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:56.996398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:56.996844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:56.997658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:56.998111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.008676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-851711fe-d897-4109-8fbe-8231ff3310a6 req-cb98ec46-f746-4936-86f0-b6cf7934dcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "name": "network-vif-plugged", "status": "completed", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:57.017187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-851711fe-d897-4109-8fbe-8231ff3310a6 req-cb98ec46-f746-4936-86f0-b6cf7934dcb8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.018763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-851711fe-d897-4109-8fbe-8231ff3310a6 req-cb98ec46-f746-4936-86f0-b6cf7934dcb8 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.029981 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-851711fe-d897-4109-8fbe-8231ff3310a6 req-cb98ec46-f746-4936-86f0-b6cf7934dcb8 service nova] Creating event network-vif-plugged:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 10:59:57.032641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-878d8cb0-0553-4f3c-9a59-4549201a3795 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Jun 15 10:59:57.033250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2000/4103] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:59:56 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:57.035920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-851711fe-d897-4109-8fbe-8231ff3310a6 req-cb98ec46-f746-4936-86f0-b6cf7934dcb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031277 Jun 15 10:59:57.036519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2104/4104] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:57.049545 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:57.050148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:57.056390 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.056868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.057619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.058048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.168903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:57.169642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:57.177757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.178133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.178917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.179355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.203129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:57.212931 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a4dedbc0-bc88-4b46-8216-12b97e2702f1 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1362 microversion: 2.1 time: 0.167516 Jun 15 10:59:57.213577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2001/4105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:57 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:57.319515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:57.330845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:57.332386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:57.333613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8785bdcf-c7da-4b56-8432-cf067117aed5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1742 microversion: 2.20 time: 0.169066 Jun 15 10:59:57.334177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2105/4106] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:57 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:59:57.968895 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:57.969526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:57.976522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.976994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:57.977750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:57.978182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.010745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.011419 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.011614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'fault' on Instance uuid 01adb0d3-da51-4b87-a318-7ec430d8d741 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:59:58.045229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:58.046250 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:58.053968 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.054420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.055537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.055985 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.057361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:58.065062 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-14960fef-57d6-4eb4-a533-34e07e63d3e1 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 200 len: 1311 microversion: 2.1 time: 0.099950 Jun 15 10:59:58.066149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2002/4107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:57 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:58.089235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a19b9cc5-8e4c-42bb-aa94-a511ea7ad857 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Jun 15 10:59:58.089811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2106/4108] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:59:58 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:58.230391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:58.231080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:58.237182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.237820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.238771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.239211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.360815 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:58.361450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:58.368225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.368666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.369457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.369889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.376084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:58.384641 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-42e5d118-481b-4433-9d23-08d5dc62ec33 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1549 microversion: 2.1 time: 0.158531 Jun 15 10:59:58.385257 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2003/4109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:58 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:59:58.402252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:58.402745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:58.409481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.410011 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.410797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:58.411374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:58.508776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-71194784-6835-44ca-8f96-f11f7233f6bb tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110393 Jun 15 10:59:58.516026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2004/4110] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 10:59:58 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:59:58.528108 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:58.537001 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:58.538613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:58.539878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bae595f9-6a5f-422f-9f4c-65da6a7fa50c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1742 microversion: 2.20 time: 0.183410 Jun 15 10:59:58.551133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2107/4111] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:58 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:59:59.084224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:59.085142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 01adb0d3-da51-4b87-a318-7ec430d8d741] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:59.091270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.091811 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.092653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.093119 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.102596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:59.106437 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:59.108817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 HTTP/1.1 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 10:59:59.110537 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. Jun 15 10:59:59.112186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '01adb0d3-da51-4b87-a318-7ec430d8d741'} Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:59:59.113921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. Jun 15 10:59:59.115358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 10:59:59.116647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 404 to user: Instance 01adb0d3-da51-4b87-a318-7ec430d8d741 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:59:59.116732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.116732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.116919 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29c5f516-3480-427f-b78f-6a14af1a2819 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741" status: 404 len: 111 microversion: 2.1 time: 0.033336 Jun 15 10:59:59.117160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.117160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.117376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2005/4112] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:59 2022] GET /compute/v2.1/servers/01adb0d3-da51-4b87-a318-7ec430d8d741 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:59:59.119901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:59.120530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:59.121504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:59.126664 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:59:59.129619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.129619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.131574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.131574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.149225 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-219e2404-5e4f-4e15-98c7-e6cc27f8671c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052498 Jun 15 10:59:59.149942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2108/4113] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 10:59:59 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:59:59.161570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:59:59.479079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f29c506-585f-4f93-ab36-858ca80a4d57 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 204 len: 0 microversion: 2.1 time: 0.361950 Jun 15 10:59:59.483348 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2006/4114] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 10:59:59 2022] DELETE /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:59:59.492037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:59.496239 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:59.509033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.510993 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.511880 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.512523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.560387 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:59:59.561699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:59:59.570586 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.571369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.573802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.574558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.780694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:59.789760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7ad5b9f5-4e6d-4488-8845-fea6ce197c0f tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.305172 Jun 15 10:59:59.790616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2109/4115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 10:59:59 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:59:59.797590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-09e1e6f4-5fd5-4f3c-91e0-30eb116bfaf7 req-b8b5e9d1-3063-47e5-ac42-7fc1e3f8b0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fd31d8-1234-4075-9891-1faa8ada2e34", "tag": "90fed5d8-e631-42fe-a73d-bac99b65542b"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:59:59.807189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-09e1e6f4-5fd5-4f3c-91e0-30eb116bfaf7 req-b8b5e9d1-3063-47e5-ac42-7fc1e3f8b0b7 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:59:59.808207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-09e1e6f4-5fd5-4f3c-91e0-30eb116bfaf7 req-b8b5e9d1-3063-47e5-ac42-7fc1e3f8b0b7 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:59:59.820143 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-09e1e6f4-5fd5-4f3c-91e0-30eb116bfaf7 req-b8b5e9d1-3063-47e5-ac42-7fc1e3f8b0b7 service nova] Creating event network-changed:90fed5d8-e631-42fe-a73d-bac99b65542b for instance 21fd31d8-1234-4075-9891-1faa8ada2e34 on hv-cinder-84580 Jun 15 10:59:59.825366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-09e1e6f4-5fd5-4f3c-91e0-30eb116bfaf7 req-b8b5e9d1-3063-47e5-ac42-7fc1e3f8b0b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033112 Jun 15 10:59:59.826206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2110/4116] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 10:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:59:59.835084 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:59.843588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:59.845218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:59:59.846403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e05edbde-9aa4-43bf-976f-8fbe31f87bdd tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.290443 Jun 15 10:59:59.847154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2007/4117] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 10:59:59 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:00.165367 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:00.166423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:00.174669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.175286 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.176791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.183752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.260495 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cf3ff756-a312-4726-aec2-39bdded04f05 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102801 Jun 15 11:00:00.264337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2111/4118] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:00:00 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 11:00:00.348358 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:00.349465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:00.361842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.364053 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.365354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.366394 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.420605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 11:00:00.814375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:00.822023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:00.847625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.858127 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.863395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.864950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.888354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a709714e-c6d9-4e65-b884-57ddbf40aa47 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 204 len: 0 microversion: 2.1 time: 0.546757 Jun 15 11:00:00.889870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2008/4119] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:00:00 2022] DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 11:00:00.902932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:00.905461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:00.921651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.922761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:00.924920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:00.927388 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:01.216921 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:01.232794 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-177bdded-699b-4ee9-a5e2-817944813d3e tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1518 microversion: 2.1 time: 0.428673 Jun 15 11:00:01.234110 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2112/4120] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:00 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1518 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:01.244105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:01.244808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:01.252714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:01.254499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:01.255434 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:01.256499 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:01.285172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:01.294329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:01.298965 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:01.302042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-bf564282-6fcb-4eff-8f50-f789a810bff5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.406251 Jun 15 11:00:01.316291 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2009/4121] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:00 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:01.495105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:01.504580 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e274db8-86c8-48a0-964f-d8170dd72c5d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1681 microversion: 2.1 time: 0.268034 Jun 15 11:00:01.507812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2113/4122] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:01 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:01.846738 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-e076a399-189d-4608-b07e-8a943953ba90 req-075827be-ac53-4472-a21a-ad6a1b06e1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79", "name": "network-vif-deleted", "tag": "55d1363c-0871-49ee-b169-b146f018e851"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:01.858807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e076a399-189d-4608-b07e-8a943953ba90 req-075827be-ac53-4472-a21a-ad6a1b06e1b9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:01.859730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e076a399-189d-4608-b07e-8a943953ba90 req-075827be-ac53-4472-a21a-ad6a1b06e1b9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:01.874139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-e076a399-189d-4608-b07e-8a943953ba90 req-075827be-ac53-4472-a21a-ad6a1b06e1b9 service nova] Creating event network-vif-deleted:55d1363c-0871-49ee-b169-b146f018e851 for instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 on hv-cinder-84580 Jun 15 11:00:01.879891 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-e076a399-189d-4608-b07e-8a943953ba90 req-075827be-ac53-4472-a21a-ad6a1b06e1b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Jun 15 11:00:01.881168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2010/4123] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:00:02.250980 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:02.251768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:02.260919 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.262451 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.262961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.263719 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.321211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:02.322493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:02.336685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.337574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.338624 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.339367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.391839 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:02.405502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-332566df-261b-477d-94bd-b271a7c0b7ec tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1476 microversion: 2.1 time: 0.158678 Jun 15 11:00:02.406064 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2114/4124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:02 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:02.532745 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:02.553613 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:02.569861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:02.576324 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.577004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.577912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:02.578371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:02.584644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:02.586966 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:02.588797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e1d80b42-185c-4aba-a2a4-2f7bc8e11840 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.271984 Jun 15 11:00:02.589961 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2011/4125] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:02 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:02.860128 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:02.869403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ef16cc3-ba78-4166-a40d-97ff71ba090b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1681 microversion: 2.1 time: 0.345013 Jun 15 11:00:02.870024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2115/4126] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:02 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1681 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:03.423996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:03.424840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:03.434597 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.435897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.435897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.437638 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.470008 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.470452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.470909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lazy-loading 'fault' on Instance uuid 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:00:03.513125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5090fa81be4d41bbb62da2c4f273d537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab32692641974828b6fa534495acca01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:03.517015 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:03.522143 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-64dbe2b2-eb19-4e1a-85c6-7b4feacdb1dc tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 200 len: 1311 microversion: 2.1 time: 0.102455 Jun 15 11:00:03.522785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2012/4127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:03 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:03.615462 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:03.615992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:03.624937 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.625586 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.626671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.627407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.891379 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:03.891920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:03.899776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.900280 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:03.901094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:03.901532 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:04.044721 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:04.053455 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-36d41d15-d43c-4e81-8842-8511f62998d7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1681 microversion: 2.1 time: 0.166558 Jun 15 11:00:04.054032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2013/4128] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:03 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:04.149622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:04.158259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:04.160379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:04.161597 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-679b9aa9-00a6-46bd-b7fb-8b05695e0e37 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.550428 Jun 15 11:00:04.162155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2116/4129] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:03 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:04.541277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:04.541937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] [instance: 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:04.551577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:04.552026 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:04.552806 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:04.553270 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:04.568246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] HTTP exception thrown: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Request method failure captured: Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 HTTP/1.1 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLPr1xk51ArmdmLvcS9CmRzHo2wyg_PDXBPuOPQYhXyr5pqwm2FAwA-fEWT8LYp_mWptqQaTl-r-aw-lHVbgKjm-esqSLuW5p-UyL3VcqfDtgCo2I-_qY7Ni28lvEWKdBHqnnOPo_FVt8iNQOAN9F5xucgLiRVqdMCEGfr2kr4ZtT8 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: ab32692641974828b6fa534495acca01 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:00:04.569942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ab32692641974828b6fa534495acca01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ab32692641974828b6fa534495acca01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ab32692641974828b6fa534495acca01", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: ab32692641974828b6fa534495acca01 Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-19207350 Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5090fa81be4d41bbb62da2c4f273d537 Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-ServerRescueNegativeTestJSON-19207350-project Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. Jun 15 11:00:04.571868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79'} Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:00:04.573092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. Jun 15 11:00:04.574836 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:04.576353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] Returning 404 to user: Instance 3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:00:04.576353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-990e35b8-8f58-4b5d-820d-a3d4c0d69991 tempest-ServerRescueNegativeTestJSON-19207350 tempest-ServerRescueNegativeTestJSON-19207350-project] 10.222.0.60 "GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79" status: 404 len: 111 microversion: 2.1 time: 0.036009 Jun 15 11:00:04.576353 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2014/4130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:04 2022] GET /compute/v2.1/servers/3fdb9fb8-5bfa-408f-8ecc-13ff29f36a79 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:00:04.769099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-c085ef44-00d7-4e8a-8bf7-5095afce6e26 req-cfc867bd-928b-4f57-8b2c-39d28ce06c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4151473-56b5-415e-b577-98d34aa05543", "name": "network-vif-deleted", "tag": "baad251a-2964-4773-bb6a-55d7aed2608e"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:04.784391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c085ef44-00d7-4e8a-8bf7-5095afce6e26 req-cfc867bd-928b-4f57-8b2c-39d28ce06c7e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:04.785899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-c085ef44-00d7-4e8a-8bf7-5095afce6e26 req-cfc867bd-928b-4f57-8b2c-39d28ce06c7e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:04.802208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-c085ef44-00d7-4e8a-8bf7-5095afce6e26 req-cfc867bd-928b-4f57-8b2c-39d28ce06c7e service nova] Creating event network-vif-deleted:baad251a-2964-4773-bb6a-55d7aed2608e for instance f4151473-56b5-415e-b577-98d34aa05543 on hv-cinder-84580 Jun 15 11:00:04.808033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-c085ef44-00d7-4e8a-8bf7-5095afce6e26 req-cfc867bd-928b-4f57-8b2c-39d28ce06c7e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042997 Jun 15 11:00:04.809520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2117/4131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:00:05.073422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:05.074369 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:05.084450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:05.089329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:05.096620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:05.097236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:05.181391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:05.182097 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:05.203657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:05.203657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:05.204845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:05.205582 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:05.288021 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:05.310200 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ebe470e8-3257-4eb8-9567-daf93e6ad176 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 200 len: 1325 microversion: 2.1 time: 0.240712 Jun 15 11:00:05.310839 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2015/4132] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:05 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:05.465421 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:05.473664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:05.475189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:05.476641 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-93af2ada-e4b5-4f6d-8829-94b4b7273a94 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.299732 Jun 15 11:00:05.477236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2118/4133] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:05 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:06.327665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:06.328774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:06.351755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:06.352500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:06.353677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:06.354233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:06.389622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 HTTP/1.1 Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:00:06.391743 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:00:06.393602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'f4151473-56b5-415e-b577-98d34aa05543'} Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:00:06.395805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:00:06.397483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:00:06.398963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:00:06.398963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e466e186-5911-4d6f-817d-bb8d5f839413 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 404 len: 111 microversion: 2.1 time: 0.071281 Jun 15 11:00:06.400033 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2016/4134] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:06 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:00:06.414549 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-11eb086e-9091-4e04-9c00-8b9e80f014b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '.version_select at 0x7fc2795cf700>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:06.495622 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:06.496550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:06.506492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:06.513611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:06.514909 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:06.515788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:06.531521 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-11eb086e-9091-4e04-9c00-8b9e80f014b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498563650" status: 202 len: 0 microversion: 2.1 time: 0.125554 Jun 15 11:00:06.534881 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2119/4135] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Jun 15 11:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498563650 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:00:06.748246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:06.758338 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:06.760108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:06.761300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3f645264-245e-4f4c-804f-0998a1cc094c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.269579 Jun 15 11:00:06.762500 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2017/4136] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:06 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:07.780386 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:07.781716 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:07.799196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:07.799952 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:07.809885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:07.810763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:08.161569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:08.188196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:08.193598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:08.196123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4239dddc-fde3-4f0e-b072-986cece17626 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.420007 Jun 15 11:00:08.215725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2120/4137] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:07 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:08.613796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-180f20f3-e47c-4079-89c2-38866e22c4ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: .version_select at 0x7fc27a11b430>, body: {"keypair": {"name": "tempest-keypair-1143287617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvnKNwmSFFWoFQB4D/dILFdP4hyrSeXD9lLRF6f+auqHtCNKABAQPkIuVdIHDgA9c8CnXjyWHC4GCOIlfn1akwuqsY99ja3l/49Ss5X0cRCx97+0dNOvfQhw1SU4vgk9g=="}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:08.642983 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-180f20f3-e47c-4079-89c2-38866e22c4ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 11:00:08.653106 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-180f20f3-e47c-4079-89c2-38866e22c4ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'key_pairs'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 11:00:08.761217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-180f20f3-e47c-4079-89c2-38866e22c4ac tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155866 Jun 15 11:00:08.762657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2018/4138] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 11:00:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:00:09.223918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:09.224540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:09.233112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:09.233856 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:09.234684 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:09.235123 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:09.569524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:09.584480 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:09.586224 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:09.589871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0e32bc86-dd21-4f28-901c-e1adca28174c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.372666 Jun 15 11:00:09.604706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2121/4139] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:09 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:10.612351 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:10.613448 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:10.619673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:10.620647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:10.624048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:10.624048 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:10.903503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:10.918101 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:10.926962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:10.928715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d9d1e14-6daf-4b96-97a8-62c14708ec18 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.321007 Jun 15 11:00:10.929915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2019/4140] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:10 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:11.958469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:11.959082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:11.966359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:11.966812 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:11.967640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:11.968076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:12.185758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:12.201524 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:12.203688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:12.205381 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ab6183e0-7760-4478-8cd8-66236a229c84 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.251739 Jun 15 11:00:12.211782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2122/4141] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:11 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:12.426555 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8745441", "imageRef": "987f3202-6ca8-4b6c-a68b-bbcdcec2196d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae25dc20-3f67-427a-9874-3a8b1d755278"}], "security_groups": [{"name": "tempest-securitygroup--1443247571"}], "key_name": "tempest-keypair-1143287617", "user_data": "}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:12.557493 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] validate_networks() for [('ae25dc20-3f67-427a-9874-3a8b1d755278', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 11:00:12.994126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 11:00:12.995666 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 11:00:12.996902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 11:00:12.997982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 11:00:12.999928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 11:00:13.017268 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:13.017768 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:13.018572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:13.019452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:13.044817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 11:00:13.049364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Getting quotas for user 4beff9397579496c80fd6e93b7a81542 and project 3ce59d9a516c4ec296e5f4e74627491b. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 11:00:13.067446 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 11:00:13.071601 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='987f3202-6ca8-4b6c-a68b-bbcdcec2196d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 11:00:13.202413 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [c445f912-becb-4955-9760-14dc47fb9267] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 11:00:13.226014 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:13.226879 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:13.236135 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:13.236894 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:13.238568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:13.239229 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:13.443796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:13.454522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:13.456450 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:13.459537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8caa22bf-e59d-4be5-97d8-5a17ce39525a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.237906 Jun 15 11:00:13.461039 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2123/4142] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:13 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:14.210458 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [c445f912-becb-4955-9760-14dc47fb9267] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40134. Jun 15 11:00:14.215574 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-06cb6ed3-a53b-403f-9845-20da936d671f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.794465 Jun 15 11:00:14.216588 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2020/4143] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 11:00:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 11:00:14.228142 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-138f3b3d-7715-4f37-ab9f-27b20bbe8f50 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:14.229737 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-138f3b3d-7715-4f37-ab9f-27b20bbe8f50 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:14.312663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-138f3b3d-7715-4f37-ab9f-27b20bbe8f50 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:14.323373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-138f3b3d-7715-4f37-ab9f-27b20bbe8f50 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1239 microversion: 2.1 time: 0.097289 Jun 15 11:00:14.323373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2124/4144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:14 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1239 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:14.486276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:14.495425 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:14.500834 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:14.501669 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:14.503122 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:14.504861 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:14.673133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:14.682149 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:14.683735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:14.684992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9702c9dc-b1c9-45c2-998e-3ee096585b04 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1737 microversion: 2.20 time: 0.207276 Jun 15 11:00:14.685615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2021/4145] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:14 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:15.341308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0fccf348-c46b-4561-b82a-02a7fc54089d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:15.341854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0fccf348-c46b-4561-b82a-02a7fc54089d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:15.415400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0fccf348-c46b-4561-b82a-02a7fc54089d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:15.424798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0fccf348-c46b-4561-b82a-02a7fc54089d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1239 microversion: 2.1 time: 0.087216 Jun 15 11:00:15.425884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2125/4146] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:15 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:15.703577 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:15.704193 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:15.710913 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:15.711367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:15.712142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:15.712762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:15.850562 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:15.859042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:15.860513 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:15.861748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1a3ffef5-673d-449b-a33f-1b6736532036 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1719 microversion: 2.20 time: 0.162042 Jun 15 11:00:15.862304 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2022/4147] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:15 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:16.442906 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-445461c7-9c7a-4e0f-bde4-fa389644d69e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:16.443509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-445461c7-9c7a-4e0f-bde4-fa389644d69e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:16.501872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-445461c7-9c7a-4e0f-bde4-fa389644d69e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:16.509915 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-445461c7-9c7a-4e0f-bde4-fa389644d69e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1239 microversion: 2.1 time: 0.071562 Jun 15 11:00:16.510764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2126/4148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:16 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:16.882171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:16.882744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:16.889554 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:16.890004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:16.890764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:16.891224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:17.028042 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:17.037067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:17.038549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:17.039707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f7c5da87-d46f-424f-99b6-c864f7480b9e tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1719 microversion: 2.20 time: 0.162254 Jun 15 11:00:17.040256 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2023/4149] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:16 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:17.528526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-200a2126-97da-4e01-8960-7c7bf47d6b8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:17.529173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-200a2126-97da-4e01-8960-7c7bf47d6b8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:17.593347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-200a2126-97da-4e01-8960-7c7bf47d6b8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:17.594606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-200a2126-97da-4e01-8960-7c7bf47d6b8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1239 microversion: 2.1 time: 0.070252 Jun 15 11:00:17.595298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2127/4150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:17 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:00:18.058266 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:18.058850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:18.065436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.065885 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.066802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.067239 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.208086 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:18.216462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:18.217980 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:18.219139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a4494ae3-9dd5-4812-bb80-0b1c701cbd74 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1722 microversion: 2.20 time: 0.164927 Jun 15 11:00:18.219692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2024/4151] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:18 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:18.238003 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f906b0-6b79-48cb-b453-e7cb75c293e2"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:18.239185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:18.245784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.246236 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.247012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.247449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.579310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-30e392a2-0bc3-4d91-a21a-b54907c81038 req-7e6d5781-d33a-48c3-ad8e-bf60a8b2ab3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "name": "network-vif-unplugged", "status": "completed", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:18.591800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-30e392a2-0bc3-4d91-a21a-b54907c81038 req-7e6d5781-d33a-48c3-ad8e-bf60a8b2ab3e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.592349 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-30e392a2-0bc3-4d91-a21a-b54907c81038 req-7e6d5781-d33a-48c3-ad8e-bf60a8b2ab3e service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.603991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.compute.server_external_events [req-30e392a2-0bc3-4d91-a21a-b54907c81038 req-7e6d5781-d33a-48c3-ad8e-bf60a8b2ab3e service nova] Unable to find a host for instance 4e5ab828-46b7-44de-9577-8ddfb3385803. Dropping event network-vif-unplugged {{(pid=118120) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 11:00:18.604845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-30e392a2-0bc3-4d91-a21a-b54907c81038 req-7e6d5781-d33a-48c3-ad8e-bf60a8b2ab3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033943 Jun 15 11:00:18.606774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2025/4152] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 15 11:00:18.611411 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:18.612020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:18.618306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.618801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.619628 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:18.619984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:18.681794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:18.690672 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-52e9c7d4-4dc5-4960-a1ab-c7dc95930fe1 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1243 microversion: 2.1 time: 0.082435 Jun 15 11:00:18.692278 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2026/4153] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:18 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:19.284321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:19.359038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2ca2ffc4-5022-45a2-b1e5-397301cd3cee tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.125089 Jun 15 11:00:19.360694 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2128/4154] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Jun 15 11:00:18 2022] POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments => generated 188 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 11:00:19.513837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:19.514457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:19.521298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:19.521745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:19.522580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:19.522962 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:19.708890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:19.709609 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:19.716400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:19.716845 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:19.717634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:19.719065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:19.781199 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:19.789461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-602ae96a-69f0-40a5-bd91-5bfef9cdd51a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1235 microversion: 2.1 time: 0.085741 Jun 15 11:00:19.790019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2129/4155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:19 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:00:20.807661 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:20.808371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:20.814739 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:20.819208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:20.819208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:20.819208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:20.880259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:20.887800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ca9a58a8-8404-4d76-b41f-4449a9ef59e7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1235 microversion: 2.1 time: 0.084065 Jun 15 11:00:20.888338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2130/4156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:20 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:00:21.904913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:21.905696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:21.912822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:21.916793 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4319f82e-aa60-477a-a9e7-a8545103ec1c tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments/f0f906b0-6b79-48cb-b453-e7cb75c293e2" status: 202 len: 0 microversion: 2.20 time: 2.403384 Jun 15 11:00:21.917599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:21.917750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2027/4157] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Jun 15 11:00:19 2022] DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments/f0f906b0-6b79-48cb-b453-e7cb75c293e2 => generated 0 bytes in 2405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 11:00:21.917878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:21.917878 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:21.974222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:21.974802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:21.982058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:21.982509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:21.983292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:21.983858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:21.990502 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:21.998394 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5de4ff8f-fb7d-4734-9eef-23d4bcfbcbe4 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1235 microversion: 2.1 time: 0.097428 Jun 15 11:00:22.002754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2131/4158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:21 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:00:22.184842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-703adc74-67d8-4fee-bf10-8bcd040a2f38 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/action" status: 202 len: 0 microversion: 2.20 time: 0.215026 Jun 15 11:00:22.185614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2028/4159] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Jun 15 11:00:21 2022] POST /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 15 11:00:22.194679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:22.195302 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:22.201330 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:22.202214 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:22.202770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:22.203144 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:22.351798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:22.359914 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:22.361465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:22.362619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2fd7aab1-9491-435a-a87f-bc2a9f9a508f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1670 microversion: 2.20 time: 0.172910 Jun 15 11:00:22.363734 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2132/4160] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:22 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:23.023857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:23.024927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:23.028194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:23.039843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:23.039843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:23.039843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:23.039843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:23.061782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:23.104991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:23.107227 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:23.115430 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-40bb30e4-f32d-4b69-a9dc-f2823cb20480 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1235 microversion: 2.1 time: 0.100003 Jun 15 11:00:23.122856 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2029/4161] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:23 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1235 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:23.384519 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:23.385243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:23.392009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:23.396537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:23.396537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:23.396537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:23.547173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:23.556320 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:23.557866 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:23.559022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-112042f9-e261-4b41-bb6a-4632e3ca976b tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1670 microversion: 2.20 time: 0.180304 Jun 15 11:00:23.559579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2133/4162] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:23 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:24.133061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:24.133691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:24.155417 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:24.161070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:24.161070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:24.161070 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:24.259917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:24.268479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c01d34c3-80ce-4f67-989a-5bbac063aed9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1299 microversion: 2.1 time: 0.139734 Jun 15 11:00:24.270148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2030/4163] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:24 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:24.578667 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:24.579264 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:24.586370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:24.590833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:24.590833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:24.590833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:24.718984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:24.727851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:24.729353 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:24.730505 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-579ec1ba-9a3b-4754-ab0b-db7343803aa7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.155754 Jun 15 11:00:24.731066 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2134/4164] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:24 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:25.296815 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:25.297762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:25.314651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:25.314651 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:25.316984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:25.317991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:25.449923 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:25.468103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c3876755-dd29-4034-83b0-3c1e48e4bcef tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1297 microversion: 2.1 time: 0.177293 Jun 15 11:00:25.468722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2031/4165] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:25 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1297 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:25.749991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:25.750683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:25.758682 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:25.759329 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:25.760294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:25.760774 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:26.011606 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:26.022762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:26.024278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:26.025493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-ee381530-2e55-48d0-9bf7-ff3116d1f734 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.279742 Jun 15 11:00:26.026062 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2135/4166] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:25 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:26.489424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:26.490929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:26.511801 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:26.513121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:26.515329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:26.520317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:26.782121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:26.808678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c029914d-a889-467c-958b-a4243f55cd8e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.319326 Jun 15 11:00:26.810052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2032/4167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:26 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:26.965333 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-2fce8b7c-a4b0-47f9-b68d-34048dd3ba8b req-cb93455c-6a1d-4188-9a0a-2ab577fd025d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3187defd-f82b-4298-b55e-eeea8d869423", "tag": "eb280006-b851-46fd-871d-ac53dd3015b2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:26.993971 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-2fce8b7c-a4b0-47f9-b68d-34048dd3ba8b req-cb93455c-6a1d-4188-9a0a-2ab577fd025d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:26.995273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-2fce8b7c-a4b0-47f9-b68d-34048dd3ba8b req-cb93455c-6a1d-4188-9a0a-2ab577fd025d service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:27.018959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-2fce8b7c-a4b0-47f9-b68d-34048dd3ba8b req-cb93455c-6a1d-4188-9a0a-2ab577fd025d service nova] Creating event network-changed:eb280006-b851-46fd-871d-ac53dd3015b2 for instance 3187defd-f82b-4298-b55e-eeea8d869423 on hv-cinder-84580 Jun 15 11:00:27.043561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-2fce8b7c-a4b0-47f9-b68d-34048dd3ba8b req-cb93455c-6a1d-4188-9a0a-2ab577fd025d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089010 Jun 15 11:00:27.044714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2136/4168] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:00:27.046758 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:27.047501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:27.061186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:27.061602 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:27.062736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:27.063248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:27.284162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:27.300251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:27.306655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:27.309258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50bbfae9-a2b7-4bd8-9d28-e8a51ed8f5b7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.267864 Jun 15 11:00:27.310520 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2033/4169] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:27 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:27.827174 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:27.831467 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:27.832816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:27.835901 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:27.841387 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:27.842037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:27.842827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:27.843473 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:27.998440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:28.007219 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9dd74a3e-2981-41ab-b8c2-6614b0784931 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.180903 Jun 15 11:00:28.008195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2137/4170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:27 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:28.334829 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:28.335378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:28.342133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:28.342576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:28.348160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:28.348160 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:28.501807 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:28.510893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:28.515384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:28.515384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1657295b-8dfb-4072-93ab-f97cd50186d4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.183113 Jun 15 11:00:28.515384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2034/4171] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:28 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:29.025501 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:29.026263 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:29.033965 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:29.034555 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:29.037005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:29.037767 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:29.204608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:29.213515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6a627cd2-0616-484c-9bca-40afc7c7e304 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.191837 Jun 15 11:00:29.214657 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2138/4172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:29 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:29.531782 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:29.532491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:29.535080 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:29.540636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:29.541426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:29.542461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:29.543157 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:29.710153 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:29.719759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:29.722508 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:29.723769 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6c14b948-82be-4dc3-a0a9-7851185e73a0 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.196073 Jun 15 11:00:29.724322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2035/4173] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:29 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:30.231508 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:30.232809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:30.239912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:30.240396 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:30.241200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:30.241634 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:30.432113 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:30.440265 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cb1ec296-6155-457f-a30a-dd0685bd2275 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.212982 Jun 15 11:00:30.441620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2139/4174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:30 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:00:30.743752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:30.744400 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:30.751022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:30.751467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:30.752229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:30.752657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:30.907196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:30.917452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:30.918981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:30.920161 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c12ebbac-f16d-4915-883e-71ab7aa19739 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.180434 Jun 15 11:00:30.920722 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2036/4175] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:30 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:31.459009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:31.465917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:31.471080 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:31.471825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:31.474189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:31.474843 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:31.661947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:31.672853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-14fbbed3-ddca-4eca-b6f7-31b57621b2e6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.218326 Jun 15 11:00:31.673474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2140/4176] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:31 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:31.942547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:31.943393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:31.955221 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:31.955546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:31.956360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:31.956800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:32.105341 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:32.114525 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:32.116578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:32.118294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6de7469-05b0-43a3-989e-0033a026de30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.182114 Jun 15 11:00:32.119109 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2037/4177] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:31 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:32.693875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:32.695134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:32.703058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:32.703800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:32.704752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:32.705383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:32.862591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:32.871412 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-67fce4e3-f53c-4789-88bf-81067c9e49b8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.183341 Jun 15 11:00:32.880842 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2141/4178] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:32 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:33.137926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:33.138538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:33.146723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:33.147173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:33.147958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:33.148393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:33.314986 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:33.325311 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:33.327415 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:33.328820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c8adf19e-03e7-4cc6-8c58-df9965df4ee4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.194933 Jun 15 11:00:33.329728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2038/4179] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:33 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:33.889604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:33.890828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:33.902049 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:33.902497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:33.905313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:33.905313 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:34.061991 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:34.070235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b5684f6a-0f30-4869-8a48-0062a67d01ca tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.185381 Jun 15 11:00:34.070828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2142/4180] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:33 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:34.356130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:34.356749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:34.365164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:34.365428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:34.366927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:34.367536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:34.521821 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:34.536929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:34.538447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:34.539632 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-29c35080-57c6-4e96-a5e5-4647f71ad705 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.189532 Jun 15 11:00:34.540235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2039/4181] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:34 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:35.087836 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:35.088507 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:35.095663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:35.096267 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:35.097012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:35.097395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:35.243730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:35.251398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5a5c0e71-4b37-4d16-ba2f-c667f84a02ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.167315 Jun 15 11:00:35.252419 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2143/4182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:35 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:35.558243 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:35.558971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:35.567319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:35.567984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:35.568947 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:35.569423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:35.745108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:35.745108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:35.745506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:35.745506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-db28d86a-d880-4a9b-b76b-77bd487ee3b5 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.188949 Jun 15 11:00:35.745506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2040/4183] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:35 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:36.271603 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:36.272511 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:36.282679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:36.283476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:36.284875 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:36.286048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:36.439247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:36.448587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1a6931a-163c-411e-8f45-a6214cf8510c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.181828 Jun 15 11:00:36.459918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2144/4184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:36 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:36.763146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:36.763794 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:36.771115 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:36.771763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:36.772619 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:36.773186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:36.928182 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:36.936594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:36.938140 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:36.939299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d87b21d6-e819-43dd-bf41-bbd91bfd7341 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.180494 Jun 15 11:00:36.939887 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2041/4185] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:36 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:37.466053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:37.466680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:37.474105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:37.474553 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:37.475328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:37.475757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:37.611032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:37.614732 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:37.619165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-033a4258-32c9-42d0-a159-7dbd31c14d34 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.156935 Jun 15 11:00:37.619730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2145/4186] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:37 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:37.957438 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:37.958051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:37.965476 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:37.965929 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:37.966700 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:37.967310 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:38.101541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:38.109917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:38.120309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:38.120309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d1fc45b9-ea06-4bb4-94f7-0d93d991c328 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.158956 Jun 15 11:00:38.120309 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2042/4187] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:37 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:38.638853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:38.638853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:38.646273 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:38.646721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:38.647493 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:38.647924 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:38.782033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:38.790733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6c2caaf-b021-44f5-a931-c63aa625b82c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.158516 Jun 15 11:00:38.791234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2146/4188] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:38 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:39.136843 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:39.137428 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:39.143914 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:39.144366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:39.145148 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:39.145585 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:39.278461 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:39.287044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:39.288595 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:39.289776 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-131dd5f4-3bb9-4925-a355-9cc5bd7068fe tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.156992 Jun 15 11:00:39.290328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2043/4189] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:39 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:39.808518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:39.809316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:39.815936 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:39.816376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:39.817161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:39.817640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:39.954828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:39.963074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-68a51878-d5ca-4de3-bf5e-4010fd600239 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.158485 Jun 15 11:00:39.963698 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2147/4190] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:39 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:40.309423 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:40.310022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:40.316526 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:40.316982 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:40.317744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:40.318172 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:40.454802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:40.463744 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:40.465244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:40.466393 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a4314383-98f9-4fb3-8929-b3a0030fbbd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.160891 Jun 15 11:00:40.466950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2044/4191] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:40 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:40.980699 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:40.981348 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:40.987645 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:40.988090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:40.988857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:40.989337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:41.121990 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:41.129793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a6d0100b-eed9-4a10-9486-07fc70ad3335 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.153068 Jun 15 11:00:41.130475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2148/4192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:40 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:41.485621 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:41.486328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:41.493489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:41.493933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:41.494716 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:41.495151 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:41.629570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:41.637928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:41.639391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:41.640644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-65a21fa3-7c70-45bd-a84a-ba09fe144a54 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.159090 Jun 15 11:00:41.641219 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2045/4193] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:41 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:42.147343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:42.148654 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:42.155632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:42.156072 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:42.156938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:42.157411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:42.298114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:42.309964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e746eff-d093-417d-8d6a-36ec8f3a020e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.166675 Jun 15 11:00:42.310542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2149/4194] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:42 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:42.662676 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:42.664058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:42.671503 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:42.672154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:42.673078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:42.673548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:42.692996 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=100 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:42.824380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:42.834674 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:42.836706 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:42.838244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d8a121d4-0cd7-482b-b690-ae66f0a4a217 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.180708 Jun 15 11:00:42.842933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2046/4195] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:42 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:43.327402 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:43.328024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:43.334758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:43.335207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:43.336584 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:43.337056 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:43.470594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:43.478452 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9508962e-525a-4f61-9394-0a7901b80918 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.154960 Jun 15 11:00:43.479022 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2150/4196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:43 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:43.857333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:43.857944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:43.864745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:43.865211 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:43.865988 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:43.866424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:44.014383 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:44.017972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:44.019457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:44.020677 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dc6ba906-58d0-4c1f-8ad9-969eb4323215 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.167510 Jun 15 11:00:44.021285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2047/4197] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:43 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:44.499318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:44.500161 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:44.511075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:44.512106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:44.513537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:44.514321 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:44.650666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:44.658360 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7379eba8-275e-4224-a711-b7a95f93ece7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.166448 Jun 15 11:00:44.658933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2151/4198] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:44 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:45.040739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:45.041364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:45.047941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:45.048391 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:45.049224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:45.049655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:45.191433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:45.200234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:45.201737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:45.202968 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9314a36f-5b62-4422-86cf-e57e299f2ae7 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.166880 Jun 15 11:00:45.203522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2048/4199] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:45 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:45.676376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:45.678365 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:45.692285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:45.696306 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:45.698408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:45.699848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:45.889568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:45.897152 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7335b258-2062-4d37-924b-2609594b0222 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.224902 Jun 15 11:00:45.897726 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2152/4200] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:45 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:46.222892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:46.223570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:46.231485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:46.232189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:46.232979 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:46.233436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:46.384509 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:46.398603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:46.401308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:46.403218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3391b549-f31b-4243-970c-89b1e51b5fd6 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.183948 Jun 15 11:00:46.404431 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2049/4201] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:46 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:46.914532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:46.915151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:46.926762 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:46.927211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:46.927996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:46.928428 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:47.066486 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:47.074942 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-636e224d-5078-4470-be0e-3032aac02956 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.164084 Jun 15 11:00:47.075411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2153/4202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:46 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:47.424167 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:47.424799 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:47.431471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:47.432024 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:47.432705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:47.433725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:47.576138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:47.585055 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:47.586620 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:47.587796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43e8e85a-2a11-4c85-9831-dc94d0f33ad4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.167680 Jun 15 11:00:47.588975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2050/4203] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:47 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 11:00:48.092200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:48.092811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:48.100368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:48.100773 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:48.101595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:48.102031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:48.276189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:48.285148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b07840ad-c777-464a-8bd3-7102eea20d72 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.196935 Jun 15 11:00:48.285666 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2154/4204] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:48 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:48.607867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:48.608543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:48.616514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:48.616514 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:48.620612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:48.620612 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:48.759904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:48.769004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:48.771075 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:48.772248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-b8b22d63-e606-4c7f-b50c-f4cd7897adfb tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.168854 Jun 15 11:00:48.772813 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2051/4205] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:48 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:49.303207 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:49.309542 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:49.313651 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:49.314095 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:49.314862 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:49.315291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:49.465913 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:49.474171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a7ebee4b-d3df-4110-9c0c-5016b95bafa8 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.175242 Jun 15 11:00:49.474754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2155/4206] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:49 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:49.791189 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:49.791739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:49.799322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:49.799760 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:49.800528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:49.801108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:49.937842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:49.945920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:49.947451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:49.949117 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ee10216b-99e5-4459-9c7e-163f144d2133 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.161379 Jun 15 11:00:49.949975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2052/4207] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:49 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:50.492375 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:50.492940 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:50.499904 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:50.500395 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:50.501189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:50.501616 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:50.641221 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:50.649247 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-90fee70d-6a58-42f9-9412-9892fbc73c74 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.160679 Jun 15 11:00:50.649829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2156/4208] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:50 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:50.968112 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:50.969378 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:50.975546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:50.976000 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:50.976762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:50.977226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:51.119783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:51.129194 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:51.130693 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:51.131880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-82c65ef8-361b-41c7-9a55-a5b97e231b30 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.168281 Jun 15 11:00:51.132725 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2053/4209] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:50 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:51.470513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-37eb9780-4c8b-4ffa-997c-25d92c0d7a7a req-7a08e31d-87e5-4b64-8721-2b33292dd947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "name": "network-vif-plugged", "status": "completed", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:51.479045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37eb9780-4c8b-4ffa-997c-25d92c0d7a7a req-7a08e31d-87e5-4b64-8721-2b33292dd947 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:51.483561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-37eb9780-4c8b-4ffa-997c-25d92c0d7a7a req-7a08e31d-87e5-4b64-8721-2b33292dd947 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:51.490743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-37eb9780-4c8b-4ffa-997c-25d92c0d7a7a req-7a08e31d-87e5-4b64-8721-2b33292dd947 service nova] Creating event network-vif-plugged:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 11:00:51.495740 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-37eb9780-4c8b-4ffa-997c-25d92c0d7a7a req-7a08e31d-87e5-4b64-8721-2b33292dd947 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028866 Jun 15 11:00:51.497170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2157/4210] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:00:51.668236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:51.668981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:51.677078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:51.677078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:51.677470 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:51.677902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:51.815635 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:51.825032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a6bc248f-3205-41a0-9be7-3dc0994d25f2 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.160616 Jun 15 11:00:51.826039 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2054/4211] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:51 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:52.152074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:52.153465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:52.160151 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:52.160600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:52.161415 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:52.161854 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:52.314485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:52.322710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:52.324811 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:52.326242 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-23379df6-e5ae-4a02-917a-27c0962bdcfa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.179260 Jun 15 11:00:52.326817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2158/4212] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:52 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:52.843375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:52.843930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:52.851241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:52.851683 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:52.852437 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:52.852865 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:52.995241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:53.004128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8bc2a0ea-f1e2-4a3b-81d1-d8f02f81c430 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.165585 Jun 15 11:00:53.004752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2055/4213] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:52 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:53.345201 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:53.345798 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:53.352617 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:53.356782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:53.356782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:53.356782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:53.499797 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:53.507918 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:53.509420 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:53.510632 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a779019f-adbc-4a43-a664-8b09916f911f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.170067 Jun 15 11:00:53.511259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2159/4214] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:53 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:54.021786 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:54.022375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:54.029567 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:54.030009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:54.030771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:54.031203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:54.176603 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:54.185629 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a931e4ab-736e-42bc-bd92-0356838799ce tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.167797 Jun 15 11:00:54.186205 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2056/4215] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:54 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:54.529474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:54.530068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:54.536703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:54.537238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:54.544032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:54.544032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:54.679205 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:54.687947 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:54.689465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:54.690611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9508e12f-4749-4250-bcfd-d6ae46f3a715 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1728 microversion: 2.20 time: 0.165634 Jun 15 11:00:54.691162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2160/4216] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:54 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:55.203623 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:55.204561 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:55.211792 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:55.212293 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:55.213094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:55.213533 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:55.364691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:55.373297 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3a46be6b-8e1b-4d3a-bf83-e53e2346b604 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.174065 Jun 15 11:00:55.373873 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2057/4217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:55 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:55.565454 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-331edb9e-0b81-47f7-a867-597be6deba18 req-09b42f24-e358-4009-b842-05a9dd832bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3187defd-f82b-4298-b55e-eeea8d869423", "name": "network-vif-plugged", "status": "completed", "tag": "eb280006-b851-46fd-871d-ac53dd3015b2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:00:55.574819 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-331edb9e-0b81-47f7-a867-597be6deba18 req-09b42f24-e358-4009-b842-05a9dd832bee service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:55.576289 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-331edb9e-0b81-47f7-a867-597be6deba18 req-09b42f24-e358-4009-b842-05a9dd832bee service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:55.587587 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-331edb9e-0b81-47f7-a867-597be6deba18 req-09b42f24-e358-4009-b842-05a9dd832bee service nova] Creating event network-vif-plugged:eb280006-b851-46fd-871d-ac53dd3015b2 for instance 3187defd-f82b-4298-b55e-eeea8d869423 on hv-cinder-84580 Jun 15 11:00:55.593237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-331edb9e-0b81-47f7-a867-597be6deba18 req-09b42f24-e358-4009-b842-05a9dd832bee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032067 Jun 15 11:00:55.593849 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2161/4218] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:00:55.709483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:55.710625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:55.730858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:55.731406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:55.737019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:55.737019 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:55.903199 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:55.911746 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:55.913491 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:55.914679 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d4111c81-f835-4f2e-bcb6-3058d5e6249a tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1715 microversion: 2.20 time: 0.209393 Jun 15 11:00:55.915246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2058/4219] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:00:55 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:00:56.391652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:56.392378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:56.398683 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:56.399121 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:56.399868 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:56.400297 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:56.558012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:56.566709 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-02543f97-f9e5-4549-a965-f3b55542a66c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.179792 Jun 15 11:00:56.567411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2162/4220] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:56 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:57.592009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:57.592616 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:57.604830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:57.604830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:57.604830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:57.604830 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:57.750857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:57.759366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-94b6eb12-4b04-4ffe-9729-6fc58c741531 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1365 microversion: 2.1 time: 0.171699 Jun 15 11:00:57.760078 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2059/4221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:57 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:58.776850 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:58.778409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:58.782134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=52 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:58.785639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:58.786086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:58.786852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:58.787294 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:58.937475 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:00:58.940877 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=100 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:00:58.945705 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4f581746-0997-4ad6-b16d-a686e83ea726 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1556 microversion: 2.1 time: 0.172640 Jun 15 11:00:58.946468 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2163/4222] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:00:58 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:00:58.968568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:00:58.968568 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:00:58.970993 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:58.971436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:58.972197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:00:58.972686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:00:59.051443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2f5b8ad6-b281-4844-b4c4-975b129ff402 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092534 Jun 15 11:00:59.052063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2060/4223] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Jun 15 11:00:58 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:01:00.359355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-0aa79a65-b2a2-4295-9f83-665e55b32700 req-95f43edb-6abc-41bf-ba4d-ed967b1e8ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3187defd-f82b-4298-b55e-eeea8d869423", "tag": "eb280006-b851-46fd-871d-ac53dd3015b2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:01:00.368803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0aa79a65-b2a2-4295-9f83-665e55b32700 req-95f43edb-6abc-41bf-ba4d-ed967b1e8ca5 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:00.369285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-0aa79a65-b2a2-4295-9f83-665e55b32700 req-95f43edb-6abc-41bf-ba4d-ed967b1e8ca5 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:00.382327 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-0aa79a65-b2a2-4295-9f83-665e55b32700 req-95f43edb-6abc-41bf-ba4d-ed967b1e8ca5 service nova] Creating event network-changed:eb280006-b851-46fd-871d-ac53dd3015b2 for instance 3187defd-f82b-4298-b55e-eeea8d869423 on hv-cinder-84580 Jun 15 11:01:00.388106 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-0aa79a65-b2a2-4295-9f83-665e55b32700 req-95f43edb-6abc-41bf-ba4d-ed967b1e8ca5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032621 Jun 15 11:01:00.388721 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2164/4224] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:33.005063 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=51 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:33.006299 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=85 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:33.196343 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:33.196842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:33.202944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:33.203938 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:33.204737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:33.205208 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:33.228373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-92a811b6-9442-447d-8ad1-b80e5a7e8d22 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/ips" status: 200 len: 147 microversion: 2.1 time: 0.226256 Jun 15 11:01:33.228932 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2061/4225] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 11:01:32 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/ips => generated 147 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:35.888198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8023e367-9894-47c3-80ff-a3738d67d234"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:01:35.889403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:35.891725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=3 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:35.892379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:35.898311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:35.898757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:35.899513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:35.899946 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:36.472912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-013be953-793b-48ba-b285-ffff390e467a tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588650 Jun 15 11:01:36.473607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2165/4226] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 11:01:35 2022] POST /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 194 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:45.024479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:45.025492 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:45.028177 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:45.028820 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:45.033958 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:45.039943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:45.039943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:45.039943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:45.068911 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7594ed3c-50f4-4c70-b47d-f920a8fabe62 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048961 Jun 15 11:01:45.069507 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2062/4227] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:01:45 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:45.080301 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:45.081018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:45.088999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:45.088999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:45.089338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:45.089757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:45.121385 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fd23b819-e052-4a78-844c-4f0d57da18b9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234" status: 200 len: 194 microversion: 2.1 time: 0.045715 Jun 15 11:01:45.121987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2166/4228] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Jun 15 11:01:45 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:46.749017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08084ff-7f80-4369-9783-af8b40d94960"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:01:46.750214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:46.758536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:46.758981 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:46.759774 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:46.760213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:47.584733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4644f980-748c-4944-8b46-1146d9cace29 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "POST /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840015 Jun 15 11:01:47.585867 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2063/4229] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 11:01:46 2022] POST /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:49.703518 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:01:49.704079 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:01:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:01:56.169133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:56.170114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:56.172548 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=4 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:56.173397 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:01:56.178959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.180164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.181078 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.181615 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.213934 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3f3559f2-286b-4f06-92c8-e8b63d8a67e5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048736 Jun 15 11:01:56.214517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2167/4230] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:01:56 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:56.366179 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:56.366747 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:56.373130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.373580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.374371 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.374803 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.405625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f86a0f53-bed6-4196-b750-cc3f258c38f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234" status: 200 len: 194 microversion: 2.1 time: 0.044744 Jun 15 11:01:56.406228 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2064/4231] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Jun 15 11:01:56 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:56.417362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:56.417966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:56.424988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.425443 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.426211 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:56.427136 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:56.511840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lazy-loading 'services' on Instance uuid 21fd31d8-1234-4075-9891-1faa8ada2e34 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:01:56.699073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b7b6c78c-4fd1-437b-91ec-58b8204265a7 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234" status: 202 len: 0 microversion: 2.1 time: 0.286706 Jun 15 11:01:56.699669 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2168/4232] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 11:01:56 2022] DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/8023e367-9894-47c3-80ff-a3738d67d234 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:01:58.871339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:58.871860 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:58.878296 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:58.878739 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:58.879485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:58.879916 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:58.910264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ad9375dd-145f-4e5e-8a39-01c8b65f81d4 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/d08084ff-7f80-4369-9783-af8b40d94960" status: 200 len: 194 microversion: 2.1 time: 0.042845 Jun 15 11:01:58.910842 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2065/4233] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Jun 15 11:01:58 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/d08084ff-7f80-4369-9783-af8b40d94960 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:01:58.922644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:58.923203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:58.929644 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:58.930004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:58.930764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:58.931196 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:59.011125 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lazy-loading 'services' on Instance uuid 21fd31d8-1234-4075-9891-1faa8ada2e34 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:01:59.190047 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dfcad0d6-cf92-4f5c-96e3-9fbc9e2a4557 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/d08084ff-7f80-4369-9783-af8b40d94960" status: 202 len: 0 microversion: 2.1 time: 0.271932 Jun 15 11:01:59.190674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2169/4234] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 11:01:58 2022] DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments/d08084ff-7f80-4369-9783-af8b40d94960 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:01:59.868412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:59.869946 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:59.875971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:59.876572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:59.877216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:59.877662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:59.907814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-4875dfa8-566d-4d4e-bfdb-84145354cfa4 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044314 Jun 15 11:01:59.908376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2066/4235] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Jun 15 11:01:59 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:01:59.969071 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:01:59.969817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:01:59.976298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:59.976748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:01:59.977540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:01:59.978002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.005503 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 11:02:00.291120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1d27755f-1aaf-4769-bba5-24f04f809ffc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 204 len: 0 microversion: 2.20 time: 0.323099 Jun 15 11:02:00.291120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2170/4236] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Jun 15 11:01:59 2022] DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 11:02:00.296899 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:00.297536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:00.303828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.304108 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.304870 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.305333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.355004 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:00.356019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:00.364099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.364551 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.365359 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.365795 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.404045 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8752b79b-e8e0-442f-83e7-ad64e8be35b5 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053964 Jun 15 11:02:00.404630 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2171/4237] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:02:00 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 11:02:00.456590 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:00.465673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:00.467155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:00.468325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2b406c0d-2446-4d14-a18a-086af2262ad1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.175249 Jun 15 11:02:00.468880 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2067/4238] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:00 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:02:00.519706 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:00.520655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:00.527722 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.528165 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.528925 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.529378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.559538 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f8eaf5ad-d767-4a64-9a80-f9508869af45 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043999 Jun 15 11:02:00.564611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2172/4239] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:02:00 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 11:02:00.618877 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:00.619376 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:00.626127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.626127 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.626924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:00.627363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:00.654904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Going to try to terminate instance {{(pid=118120) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 11:02:00.992426 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cb79fa2b-fc80-48ff-add5-2ed2014f9459 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 204 len: 0 microversion: 2.1 time: 0.376965 Jun 15 11:02:00.993164 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2068/4240] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:00 2022] DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 11:02:01.002132 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:01.002807 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:01.010181 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:01.013708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:01.013708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:01.013708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:01.142686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:01.150408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5d8710cc-01c1-4b7c-b45e-20324fa6d3fe tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1674 microversion: 2.1 time: 0.152989 Jun 15 11:02:01.150979 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2173/4241] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:00 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:01.488974 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:01.492145 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:01.496662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:01.497226 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:01.497994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:01.498433 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:01.638546 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:01.646960 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:01.648452 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:01.649625 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ec035428-73fc-429b-b909-9189665a99a8 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.165030 Jun 15 11:02:01.650178 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2069/4242] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:01 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:02:02.167714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:02.168346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:02.175361 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:02.175796 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:02.176563 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:02.176987 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:02.304465 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:02.312081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-79fe33ac-2853-431f-b006-e08f9a38841c tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1674 microversion: 2.1 time: 0.148152 Jun 15 11:02:02.312652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2174/4243] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:02 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:02.668420 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:02.669054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:02.675754 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:02.676202 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:02.676995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:02.677436 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:02.813857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:02.823294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:02.824755 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:02.825935 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9d114c6f-735f-4218-b70c-00c6674699e9 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.161477 Jun 15 11:02:02.826487 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2070/4244] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:02 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:02:03.330160 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:03.330809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:03.337848 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:03.338282 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:03.339029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:03.339457 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:03.511043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:03.519000 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f61969ec-6fd9-444f-a961-f5f1772d10d6 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1674 microversion: 2.1 time: 0.192637 Jun 15 11:02:03.520530 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2175/4245] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:03 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1674 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:03.845551 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:03.846406 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:03.853858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:03.854404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:03.855251 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:03.855915 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:04.087741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:04.096384 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:04.097936 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:04.099128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-d7fd238f-c175-4c9b-9bf9-99ee688d1414 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1721 microversion: 2.20 time: 0.257524 Jun 15 11:02:04.099695 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2071/4246] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:03 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:02:04.541154 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:04.544400 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:04.561678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:04.562129 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:04.562905 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:04.563382 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:04.582564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-8b01fbde-1790-4134-8202-9b13abdc0ba8 req-e64ecd5f-889f-4bae-aa72-879e4b9ca54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5ab828-46b7-44de-9577-8ddfb3385803", "name": "network-vif-deleted", "tag": "0db562c7-2590-46fb-8275-dc9af90f0266"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:04.601902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-8b01fbde-1790-4134-8202-9b13abdc0ba8 req-e64ecd5f-889f-4bae-aa72-879e4b9ca54c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:04.601902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-8b01fbde-1790-4134-8202-9b13abdc0ba8 req-e64ecd5f-889f-4bae-aa72-879e4b9ca54c service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:04.626523 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-8b01fbde-1790-4134-8202-9b13abdc0ba8 req-e64ecd5f-889f-4bae-aa72-879e4b9ca54c service nova] Creating event network-vif-deleted:0db562c7-2590-46fb-8275-dc9af90f0266 for instance 4e5ab828-46b7-44de-9577-8ddfb3385803 on hv-cinder-84580 Jun 15 11:02:04.655079 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-8b01fbde-1790-4134-8202-9b13abdc0ba8 req-e64ecd5f-889f-4bae-aa72-879e4b9ca54c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076178 Jun 15 11:02:04.655737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2072/4247] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:02:04.933225 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-5b6f3e48-7336-4f1c-9130-2105b51467b2 req-ecb61ffe-9f54-4811-b67f-8dd1b4d07a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fd31d8-1234-4075-9891-1faa8ada2e34", "name": "network-vif-deleted", "tag": "90fed5d8-e631-42fe-a73d-bac99b65542b"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:04.954967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5b6f3e48-7336-4f1c-9130-2105b51467b2 req-ecb61ffe-9f54-4811-b67f-8dd1b4d07a56 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:04.954967 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-5b6f3e48-7336-4f1c-9130-2105b51467b2 req-ecb61ffe-9f54-4811-b67f-8dd1b4d07a56 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:04.971054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-5b6f3e48-7336-4f1c-9130-2105b51467b2 req-ecb61ffe-9f54-4811-b67f-8dd1b4d07a56 service nova] Creating event network-vif-deleted:90fed5d8-e631-42fe-a73d-bac99b65542b for instance 21fd31d8-1234-4075-9891-1faa8ada2e34 on hv-cinder-84580 Jun 15 11:02:04.993244 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-5b6f3e48-7336-4f1c-9130-2105b51467b2 req-ecb61ffe-9f54-4811-b67f-8dd1b4d07a56 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065408 Jun 15 11:02:04.993908 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2073/4248] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:02:05.017539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:05.028523 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a300404f-712a-42cc-951d-9ecbfbd623f8 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1606 microversion: 2.1 time: 0.494026 Jun 15 11:02:05.030781 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2176/4249] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:04 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1606 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:05.121472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:05.122583 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:05.134317 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:05.135680 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:05.136787 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:05.137686 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:05.192515 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:05.193110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:05.193644 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lazy-loading 'fault' on Instance uuid 4e5ab828-46b7-44de-9577-8ddfb3385803 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:02:05.242322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:05.251995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:05.254126 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bbb69faf3ec54489a92fe87935f2f777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbcfca56769742b9b3645f8f7c9bc6e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:05.263125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-fc4eece4-9867-45b9-ad06-15b1bf59a3fa tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 200 len: 1369 microversion: 2.20 time: 0.141333 Jun 15 11:02:05.263125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2074/4250] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:05 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 1369 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 11:02:06.046471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:06.049458 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:06.054215 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:06.054887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:06.055594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:06.056019 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:06.087349 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:06.087777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:06.088569 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lazy-loading 'fault' on Instance uuid 21fd31d8-1234-4075-9891-1faa8ada2e34 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:02:06.130970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f1e192f3eab42ee9f9ed5d2789e0d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a09fe8836f914998aec8ee2afcca9e16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:06.144743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-aadf277b-a716-4a51-be39-76de950c5f52 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 200 len: 1326 microversion: 2.1 time: 0.101598 Jun 15 11:02:06.146031 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2177/4251] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:06 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:06.277214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:06.278276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:06.286277 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:06.287020 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:06.287804 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:06.289139 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:06.314191 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] HTTP exception thrown: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Request method failure captured: Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 HTTP/1.1 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLL-oG7C98tf4ZT-U8xtde-XFwLQ9vo3y4sjEzQB_mOSUfeFcv0UiVK9ox7jFbk7lue-koLVqijKeBu7W2TE-d4niHEzQp8VoK5jSE_ikcyS23eFxc8IfsYiwMZ18mi1yWq24igMFzyJ__vzyU22srQwzBsaaMyVlneZnSIt-goq3Y Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:06.317548 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbcfca56769742b9b3645f8f7c9bc6e3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: bbb69faf3ec54489a92fe87935f2f777 Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:06.319581 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '4e5ab828-46b7-44de-9577-8ddfb3385803'} Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:06.320731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:06.326188 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:06.327528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Returning 404 to user: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:06.327528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-144ff4cf-bcda-470a-88eb-85b58e6c6e73 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 404 len: 111 microversion: 2.20 time: 0.049337 Jun 15 11:02:06.327528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2075/4252] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:06 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:06.329992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cfd40de1-add6-4967-85c0-84249617a92f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '.version_select at 0x7fc2797468b0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:06.409005 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cfd40de1-add6-4967-85c0-84249617a92f tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630401169" status: 204 len: 0 microversion: 2.20 time: 0.082885 Jun 15 11:02:06.409594 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2178/4253] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Jun 15 11:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630401169 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 11:02:07.165884 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:07.166572 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:07.172544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:07.173010 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:07.173972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:07.174404 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:07.189319 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 HTTP/1.1 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:07.190871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:07.192730 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '21fd31d8-1234-4075-9891-1faa8ada2e34'} Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:07.193703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:07.195123 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:07.197124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:07.197124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-43d5dcec-16fe-44aa-ac87-189e26078270 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 404 len: 111 microversion: 2.1 time: 0.030742 Jun 15 11:02:07.197124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2076/4254] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:07 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:07.203051 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-e1ae4d3b-7393-4536-bd39-4daf735a8c26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '.version_select at 0x7fc279687c10>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:07.283765 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-e1ae4d3b-7393-4536-bd39-4daf735a8c26 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307745814" status: 202 len: 0 microversion: 2.1 time: 0.085435 Jun 15 11:02:07.284346 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2179/4255] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Jun 15 11:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307745814 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:02:08.506103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:08.506636 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:08.513250 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:08.513737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:08.514522 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:08.514933 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:08.529549 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] HTTP exception thrown: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Request method failure captured: Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 HTTP/1.1 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLL-oG7C98tf4ZT-U8xtde-XFwLQ9vo3y4sjEzQB_mOSUfeFcv0UiVK9ox7jFbk7lue-koLVqijKeBu7W2TE-d4niHEzQp8VoK5jSE_ikcyS23eFxc8IfsYiwMZ18mi1yWq24igMFzyJ__vzyU22srQwzBsaaMyVlneZnSIt-goq3Y Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:08.531171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbcfca56769742b9b3645f8f7c9bc6e3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: bbb69faf3ec54489a92fe87935f2f777 Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.541218 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '4e5ab828-46b7-44de-9577-8ddfb3385803'} Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:08.542370 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.544171 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.546483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Returning 404 to user: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:08.546483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9489a6ba-79b5-4503-bd1e-b4027083dcf1 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 404 len: 111 microversion: 2.20 time: 0.030607 Jun 15 11:02:08.546483 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2077/4256] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Jun 15 11:02:08 2022] DELETE /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:08.547963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:08.548575 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 4e5ab828-46b7-44de-9577-8ddfb3385803] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:08.555515 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:08.555970 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:08.556770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:08.557241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:08.571763 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] HTTP exception thrown: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Request method failure captured: Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 HTTP/1.1 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLL-oG7C98tf4ZT-U8xtde-XFwLQ9vo3y4sjEzQB_mOSUfeFcv0UiVK9ox7jFbk7lue-koLVqijKeBu7W2TE-d4niHEzQp8VoK5jSE_ikcyS23eFxc8IfsYiwMZ18mi1yWq24igMFzyJ__vzyU22srQwzBsaaMyVlneZnSIt-goq3Y Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:08.573474 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbcfca56769742b9b3645f8f7c9bc6e3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: bbb69faf3ec54489a92fe87935f2f777 Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.575339 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '4e5ab828-46b7-44de-9577-8ddfb3385803'} Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:08.576642 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. Jun 15 11:02:08.585752 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:08.588992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Returning 404 to user: Instance 4e5ab828-46b7-44de-9577-8ddfb3385803 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:08.588992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-befa194c-89c8-4ba4-8a00-ca115fb8da61 tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803" status: 404 len: 111 microversion: 2.20 time: 0.031678 Jun 15 11:02:08.588992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2180/4257] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:08 2022] GET /compute/v2.1/servers/4e5ab828-46b7-44de-9577-8ddfb3385803 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:10.056904 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:10.057485 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:10.063964 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.064412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.065222 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.065663 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.079421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] HTTP exception thrown: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Request method failure captured: Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc HTTP/1.1 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLL-oG7C98tf4ZT-U8xtde-XFwLQ9vo3y4sjEzQB_mOSUfeFcv0UiVK9ox7jFbk7lue-koLVqijKeBu7W2TE-d4niHEzQp8VoK5jSE_ikcyS23eFxc8IfsYiwMZ18mi1yWq24igMFzyJ__vzyU22srQwzBsaaMyVlneZnSIt-goq3Y Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:10.081064 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbcfca56769742b9b3645f8f7c9bc6e3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: bbb69faf3ec54489a92fe87935f2f777 Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.083104 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '68397bf4-b7e5-40fa-a541-3a52382f6fcc'} Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:10.084190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.086067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.089129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Returning 404 to user: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:10.089129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-dcc0aa20-4d5c-4951-927f-a333241252dc tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 404 len: 111 microversion: 2.20 time: 0.029635 Jun 15 11:02:10.089129 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2078/4258] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Jun 15 11:02:10 2022] DELETE /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:10.092033 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:10.092663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] [instance: 68397bf4-b7e5-40fa-a541-3a52382f6fcc] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:10.099311 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.103754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.103754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.103754 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.115612 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] HTTP exception thrown: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Request method failure captured: Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc HTTP/1.1 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLL-oG7C98tf4ZT-U8xtde-XFwLQ9vo3y4sjEzQB_mOSUfeFcv0UiVK9ox7jFbk7lue-koLVqijKeBu7W2TE-d4niHEzQp8VoK5jSE_ikcyS23eFxc8IfsYiwMZ18mi1yWq24igMFzyJ__vzyU22srQwzBsaaMyVlneZnSIt-goq3Y Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:10.117184 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bbcfca56769742b9b3645f8f7c9bc6e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bbcfca56769742b9b3645f8f7c9bc6e3", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: bbcfca56769742b9b3645f8f7c9bc6e3 Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1486604357 Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: bbb69faf3ec54489a92fe87935f2f777 Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1486604357-project Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.119790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '68397bf4-b7e5-40fa-a541-3a52382f6fcc'} Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:10.120818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. Jun 15 11:02:10.122471 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.123977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] Returning 404 to user: Instance 68397bf4-b7e5-40fa-a541-3a52382f6fcc could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:10.123977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f628c46b-25bc-4279-b70e-624f534a5a7d tempest-AttachVolumeShelveTestJSON-1486604357 tempest-AttachVolumeShelveTestJSON-1486604357-project] 10.222.0.60 "GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc" status: 404 len: 111 microversion: 2.20 time: 0.030845 Jun 15 11:02:10.123977 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2181/4259] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Jun 15 11:02:10 2022] GET /compute/v2.1/servers/68397bf4-b7e5-40fa-a541-3a52382f6fcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:10.653192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:10.653684 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:10.659817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.660258 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.661038 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.661471 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.665857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:10.675389 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 HTTP/1.1 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:10.678229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.680067 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '21fd31d8-1234-4075-9891-1faa8ada2e34'} Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:10.681690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.683360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.685150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:10.685150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3e870cba-335c-43f9-87c2-eef4048092c9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 404 len: 111 microversion: 2.1 time: 0.031439 Jun 15 11:02:10.685150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2079/4260] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:10 2022] DELETE /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:10.688800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:10.689532 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 21fd31d8-1234-4075-9891-1faa8ada2e34] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:10.695591 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.696621 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.697655 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:10.698202 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:10.712828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 HTTP/1.1 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:10.714378 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.715984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '21fd31d8-1234-4075-9891-1faa8ada2e34'} Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:10.716826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. Jun 15 11:02:10.718259 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:10.720748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 21fd31d8-1234-4075-9891-1faa8ada2e34 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:10.720748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1b0d0a67-7dfe-4208-933e-aeb100328da9 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34" status: 404 len: 111 microversion: 2.1 time: 0.030756 Jun 15 11:02:10.720748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2182/4261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:10 2022] GET /compute/v2.1/servers/21fd31d8-1234-4075-9891-1faa8ada2e34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:11.992736 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:11.994009 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:12.002058 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:12.002578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:12.003233 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:12.003699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:12.019888 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 HTTP/1.1 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:12.021490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.023396 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '7b3a5478-7be1-4af4-913f-48a2c5ee7199'} Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:12.025284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.028690 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.031606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:12.031606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3bc9ad37-b09b-4558-ab48-afefee51bbee tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 404 len: 111 microversion: 2.1 time: 0.034482 Jun 15 11:02:12.031606 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2080/4262] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:11 2022] DELETE /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:12.037341 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:12.041497 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] [instance: 7b3a5478-7be1-4af4-913f-48a2c5ee7199] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:12.045337 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:12.045853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:12.046679 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:12.047195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:12.062561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] HTTP exception thrown: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Request method failure captured: Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 HTTP/1.1 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLMcukCWvdbDKEJkbGb3EKwwkQ5xG54XU5ZoVCm-7sZ4W_rCFghZJn3RJX4-sccq8VCuefcbNP1mq3VneKX6x8e7qFumScyMXEROwYjYaTP1ja_5tKniPEDPIp6pGgCRvLG7HxSmrtVBJYOUd_2CezbL1T1bcCa96yekV70-HbBzWQ Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:12.064429 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a09fe8836f914998aec8ee2afcca9e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a09fe8836f914998aec8ee2afcca9e16", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: a09fe8836f914998aec8ee2afcca9e16 Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeTestJSON-91002374 Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 9f1e192f3eab42ee9f9ed5d2789e0d1e Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeTestJSON-91002374-project Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.066332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '7b3a5478-7be1-4af4-913f-48a2c5ee7199'} Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:12.067552 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. Jun 15 11:02:12.069220 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:12.071226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] Returning 404 to user: Instance 7b3a5478-7be1-4af4-913f-48a2c5ee7199 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:12.071226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c515a2d-be3d-4704-b1a4-ff8a50259358 tempest-AttachVolumeTestJSON-91002374 tempest-AttachVolumeTestJSON-91002374-project] 10.222.0.60 "GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199" status: 404 len: 111 microversion: 2.1 time: 0.033836 Jun 15 11:02:12.071226 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2183/4263] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:12 2022] GET /compute/v2.1/servers/7b3a5478-7be1-4af4-913f-48a2c5ee7199 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:15.750691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:15.751339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:15.755249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:15.765298 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:15.765855 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:15.767249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:15.767928 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:15.802752 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-8f05fa42-6c93-4edc-aacf-f3042cfa71d6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/ips" status: 200 len: 151 microversion: 2.1 time: 0.060761 Jun 15 11:02:15.803350 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2081/4264] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 11:02:15 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:16.500380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8103901e-9f45-4b90-bcc2-b58663b03bfe tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Action: 'create', calling method: .version_select at 0x7fc27df2c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1602646643", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:17.192096 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8103901e-9f45-4b90-bcc2-b58663b03bfe tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.854410 Jun 15 11:02:17.192710 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2184/4265] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Jun 15 11:02:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 856 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 11:02:17.205246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-81e92520-c00e-48f4-bd97-8054a4248d4b tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc2792249d0>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:17.256576 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-81e92520-c00e-48f4-bd97-8054a4248d4b tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 200 len: 353 microversion: 2.1 time: 0.055768 Jun 15 11:02:17.256927 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2082/4266] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:17 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:18.269861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-009ad47a-b2a5-4437-99b8-ec6c0c2e5b56 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc27dedcc10>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:18.320276 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-009ad47a-b2a5-4437-99b8-ec6c0c2e5b56 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 200 len: 353 microversion: 2.1 time: 0.054579 Jun 15 11:02:18.321115 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2185/4267] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:18 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:18.629034 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2da577-5829-4cbf-9822-1e8c63c2bac4"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:18.630102 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:18.637001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:18.637510 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:18.638273 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:18.642618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:18.804423 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57f7f24e-4c77-4de3-87fb-f2c2fd29118b tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Action: 'create', calling method: .version_select at 0x7fc27df13310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1078548176", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57f7f24e-4c77-4de3-87fb-f2c2fd29118b tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 122 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:18.821671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1078548176", "metadata": {"Type": "work"}}} Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:18.823076 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1078548176', 'metadata': {'Type': 'work'}}}} Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise error Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:18.823818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 11:02:18.825058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 11:02:18.826081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 11:02:18.826081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.826081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-57f7f24e-4c77-4de3-87fb-f2c2fd29118b tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:18.826081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-57f7f24e-4c77-4de3-87fb-f2c2fd29118b tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139704 Jun 15 11:02:18.826081 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2186/4268] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Jun 15 11:02:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 11:02:18.833240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5fc33c89-f83a-4ff1-92f6-0ef6febef641 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Action: 'create', calling method: .version_select at 0x7fc27dece430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1814943477", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5fc33c89-f83a-4ff1-92f6-0ef6febef641 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 120 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:18.835676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1814943477", "metadata": {"Type": "work"}}} Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:18.837676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1814943477', 'metadata': {'Type': 'work'}}}} Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise error Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi '0' Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:18.838840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 11:02:18.840790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 11:02:18.842448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 11:02:18.842448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.842448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5fc33c89-f83a-4ff1-92f6-0ef6febef641 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:18.842448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5fc33c89-f83a-4ff1-92f6-0ef6febef641 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007906 Jun 15 11:02:18.842448 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2187/4269] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Jun 15 11:02:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:18.848693 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7468d89b-19df-41cd-b695-4a27fedc5480 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Action: 'create', calling method: .version_select at 0x7fc27babef70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1438144351", "metadata": {"Type": "work"}}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7468d89b-19df-41cd-b695-4a27fedc5480 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 119 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:18.850963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1438144351", "metadata": {"Type": "work"}}} Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:18.852827 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1438144351', 'metadata': {'Type': 'work'}}}} Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise error Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi '' Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:18.853577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 11:02:18.854578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 11:02:18.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 11:02:18.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7468d89b-19df-41cd-b695-4a27fedc5480 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:18.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7468d89b-19df-41cd-b695-4a27fedc5480 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008747 Jun 15 11:02:18.855558 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2188/4270] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Jun 15 11:02:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 11:02:18.863599 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f191273-d473-4594-aaf4-ea2f0bb2446c tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Calling method '.version_select at 0x7fc27df2c790>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:18.893179 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-2f191273-d473-4594-aaf4-ea2f0bb2446c tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] HTTP exception thrown: Volume tempest-invalid-114624707 could not be found. Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f191273-d473-4594-aaf4-ea2f0bb2446c tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-114624707 HTTP/1.1 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:18.895043 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Volume tempest-invalid-114624707 could not be found. Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': 'tempest-invalid-114624707'} Jun 15 11:02:18.896230 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-114624707 could not be found. (HTTP 404) (Request-ID: req-f93d7ee1-8035-4727-a595-057795eff65d) Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.897006 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 11:02:18.900690 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-114624707 could not be found. Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:18.901627 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-114624707 could not be found. Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-114624707 could not be found. Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f191273-d473-4594-aaf4-ea2f0bb2446c tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 404 to user: Volume tempest-invalid-114624707 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f191273-d473-4594-aaf4-ea2f0bb2446c tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-114624707" status: 404 len: 98 microversion: 2.1 time: 0.036474 Jun 15 11:02:18.902803 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2189/4271] 10.222.0.60 () {58 vars in 1214 bytes} [Wed Jun 15 11:02:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-114624707 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 15 11:02:18.907345 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-fa57d1ce-9c06-4bb9-bb6a-74334a8789e0 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004349 Jun 15 11:02:18.908145 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2190/4272] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Jun 15 11:02:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 11:02:18.916852 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-586b9730-a3db-457f-adf8-4abe0dad440d tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004120 Jun 15 11:02:18.917646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2191/4273] 10.222.0.60 () {58 vars in 1136 bytes} [Wed Jun 15 11:02:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 15 11:02:18.926948 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cd66b60-0063-4920-950c-4f8a681e172f tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Calling method '.version_select at 0x7fc27dece820>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:18.957461 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-4cd66b60-0063-4920-950c-4f8a681e172f tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] HTTP exception thrown: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cd66b60-0063-4920-950c-4f8a681e172f tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/os-volumes/898fa61c-75e9-47e7-831d-5b2430fee506 HTTP/1.1 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:18.959372 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '898fa61c-75e9-47e7-831d-5b2430fee506'} Jun 15 11:02:18.960513 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. (HTTP 404) (Request-ID: req-6a318483-b24a-476f-881f-8107077700d2) Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.961155 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 11:02:18.962631 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 11:02:18.963590 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4cd66b60-0063-4920-950c-4f8a681e172f tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 404 to user: Volume 898fa61c-75e9-47e7-831d-5b2430fee506 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4cd66b60-0063-4920-950c-4f8a681e172f tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/898fa61c-75e9-47e7-831d-5b2430fee506" status: 404 len: 109 microversion: 2.1 time: 0.037400 Jun 15 11:02:18.964431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2192/4274] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 11:02:18 2022] DELETE /compute/v2.1/os-volumes/898fa61c-75e9-47e7-831d-5b2430fee506 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:18.971249 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95ceee9b-0b83-404f-b7a8-5a66715cd494 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Calling method '.version_select at 0x7fc27dece8b0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:18.998903 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-95ceee9b-0b83-404f-b7a8-5a66715cd494 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] HTTP exception thrown: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95ceee9b-0b83-404f-b7a8-5a66715cd494 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Request method failure captured: Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/os-volumes/99367092-867d-455a-8b09-2b94ad7890c1 HTTP/1.1 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbw6me7e3ruDor0lyooGCYYOtaORNtbdL_DmfQZFa9cRavZtH1LXomQl51hHlAD2s07YFCSH1amRdDE668De9O1TXN0MRY1TaK_nhVJkUMW7lFENwjJyI9MAINALzvt-ifdwn_CVLaeIRrmyDdjpXE5xexx2fx-pxXn4EKnSstHHTls Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:19.000912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3e290776a3b640dda072c7b129799621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3e290776a3b640dda072c7b129799621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3e290776a3b640dda072c7b129799621", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3e290776a3b640dda072c7b129799621 Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-VolumesNegativeTest-1716916160 Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 69b3cc21829c4ac88a63bbb9ffd39a86 Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-VolumesNegativeTest-1716916160-project Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '99367092-867d-455a-8b09-2b94ad7890c1'} Jun 15 11:02:19.002171 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. (HTTP 404) (Request-ID: req-6f296c98-f30b-4606-8e24-60d7c80741ec) Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:19.002899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 11:02:19.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 11:02:19.004696 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-95ceee9b-0b83-404f-b7a8-5a66715cd494 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] Returning 404 to user: Volume 99367092-867d-455a-8b09-2b94ad7890c1 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-95ceee9b-0b83-404f-b7a8-5a66715cd494 tempest-VolumesNegativeTest-1716916160 tempest-VolumesNegativeTest-1716916160-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/99367092-867d-455a-8b09-2b94ad7890c1" status: 404 len: 109 microversion: 2.1 time: 0.035253 Jun 15 11:02:19.005828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2193/4275] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:18 2022] GET /compute/v2.1/os-volumes/99367092-867d-455a-8b09-2b94ad7890c1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 11:02:19.334198 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-941524b0-7e92-4160-871d-4ee336c918f5 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc279746a60>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:19.383194 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-941524b0-7e92-4160-871d-4ee336c918f5 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 200 len: 354 microversion: 2.1 time: 0.053570 Jun 15 11:02:19.384104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2194/4276] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:19 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:02:19.391718 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-0c6cb2fc-7e0d-429f-b72c-5cef6ae123ff tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "POST /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766722 Jun 15 11:02:19.392374 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2083/4277] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 11:02:18 2022] POST /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:19.410528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-348477e1-17fa-497c-a837-c650a39634c5 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc27dedc0d0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:19.466522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-348477e1-17fa-497c-a837-c650a39634c5 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 200 len: 354 microversion: 2.1 time: 0.060647 Jun 15 11:02:19.467170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2195/4278] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:19 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:19.484809 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-306db468-3189-43ce-945b-da35ca4a9981 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc27a0d2430>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:19.716984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-306db468-3189-43ce-945b-da35ca4a9981 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 202 len: 0 microversion: 2.1 time: 0.236179 Jun 15 11:02:19.716984 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2084/4279] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Jun 15 11:02:19 2022] DELETE /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:02:19.723831 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-be3ed2cc-0bb8-4499-8d8e-375996e26b2b tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc27df09af0>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:19.774208 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-be3ed2cc-0bb8-4499-8d8e-375996e26b2b tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 200 len: 353 microversion: 2.1 time: 0.053833 Jun 15 11:02:19.774789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2196/4280] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:19 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:20.786750 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28a25773-2ab0-4740-aec9-02421107b1a9 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Calling method '.version_select at 0x7fc27decfa60>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:20.816409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-28a25773-2ab0-4740-aec9-02421107b1a9 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] HTTP exception thrown: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28a25773-2ab0-4740-aec9-02421107b1a9 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Request method failure captured: Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff HTTP/1.1 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbw4II93whPYXlj5rnIzLbC722hPP_EnoETEsrgCjkxetTayOPJuszC8byCyYbWxdo1GbE7ruKL92Zc75ted1XHGGCmKK5_3VJDvvOsa31iMcRmxfux0wB9YZpfos0BWNKyMnrZxisihGpNnkZHQboCYcNg8iBPyF5AtpD2kz2vVESU Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: f01e7ea926544200a89bc6554fe7ad11 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-VolumesGetTestJSON-92535117 Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:20.818489 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f01e7ea926544200a89bc6554fe7ad11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f01e7ea926544200a89bc6554fe7ad11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f01e7ea926544200a89bc6554fe7ad11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f01e7ea926544200a89bc6554fe7ad11", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-VolumesGetTestJSON-92535117 Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: f01e7ea926544200a89bc6554fe7ad11 Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-VolumesGetTestJSON-92535117 Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-VolumesGetTestJSON-92535117-project Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 68e854ada59343f2bea86961e83eda4e Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-VolumesGetTestJSON-92535117-project Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'd26c1342-aa93-4f2f-a1f2-541186b58eff'} Jun 15 11:02:20.819687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. (HTTP 404) (Request-ID: req-21f88844-0b73-4d17-9b18-7d32129e0ee4) Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:20.820465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 11:02:20.821633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 11:02:20.823096 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-28a25773-2ab0-4740-aec9-02421107b1a9 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] Returning 404 to user: Volume d26c1342-aa93-4f2f-a1f2-541186b58eff could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-28a25773-2ab0-4740-aec9-02421107b1a9 tempest-VolumesGetTestJSON-92535117 tempest-VolumesGetTestJSON-92535117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff" status: 404 len: 109 microversion: 2.1 time: 0.037729 Jun 15 11:02:20.824253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2085/4281] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Jun 15 11:02:20 2022] GET /compute/v2.1/os-volumes/d26c1342-aa93-4f2f-a1f2-541186b58eff => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:28.083579 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:28.084316 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:28.089139 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:28.089625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:28.095959 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:28.096680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:28.097562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:28.098023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:28.185604 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.objects.instance [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lazy-loading 'services' on Instance uuid 3187defd-f82b-4298-b55e-eeea8d869423 {{(pid=118121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:02:28.382674 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-36e95e36-ef69-41d0-be29-76777999f07d tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments/aa2da577-5829-4cbf-9822-1e8c63c2bac4" status: 202 len: 0 microversion: 2.1 time: 0.300107 Jun 15 11:02:28.383342 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2197/4282] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 11:02:28 2022] DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments/aa2da577-5829-4cbf-9822-1e8c63c2bac4 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:02:28.394017 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:28.395192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:28.403468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:28.403922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:28.404705 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:28.405181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:28.436187 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ae86ab02-2e7c-4639-99b6-c4ad31e74a7c tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047483 Jun 15 11:02:28.440234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2086/4283] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:02:28 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:29.453676 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:29.456487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:29.464749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:29.465232 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:29.466206 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:29.466769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:29.500358 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-52825406-737d-47ad-9546-00e6af9444af tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055572 Jun 15 11:02:29.500951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2198/4284] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:02:29 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:30.512385 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:30.513339 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:30.520124 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.520571 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:30.521386 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.521805 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:30.553460 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-38a48553-d661-469c-812c-15ce9bac452b tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045620 Jun 15 11:02:30.554332 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2087/4285] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:02:30 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 11:02:30.614312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:30.615608 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:30.625585 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.626449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:30.627354 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.627933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:30.654974 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 11:02:30.954566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d26ed706-1552-40b1-aa4d-0f05efa7a373 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 204 len: 0 microversion: 2.1 time: 0.344452 Jun 15 11:02:30.955141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2199/4286] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:30 2022] DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 11:02:30.963715 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:30.964320 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:30.970594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.971035 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:30.971791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:30.972220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:31.113645 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:31.122360 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-688f1be2-a59b-4443-adf5-2f4d6f7f628e tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1681 microversion: 2.1 time: 0.162882 Jun 15 11:02:31.122951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2088/4287] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:30 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:32.140743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:32.141525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:32.148550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:32.149098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:32.149933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:32.150371 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:32.287928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:32.296711 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2bdb5fe9-cd30-4879-b1b1-6936167ecf0f tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1681 microversion: 2.1 time: 0.160417 Jun 15 11:02:32.297328 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2200/4288] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:32 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:33.314213 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:33.314822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:33.321469 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:33.321920 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:33.322675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:33.323111 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:33.456658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:33.464524 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-59522757-c6cd-4581-9476-78e988efe9b7 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1681 microversion: 2.1 time: 0.155015 Jun 15 11:02:33.465737 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2089/4289] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:33 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:34.483223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:34.484109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:34.490920 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:34.491368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:34.492177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:34.492680 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:34.637917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:34.641255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3e9660ef-afce-4ef1-a5df-5cb1caf8bb83 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1681 microversion: 2.1 time: 0.162448 Jun 15 11:02:34.641835 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2201/4290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:34 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:35.659092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:35.659714 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:35.667284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:35.667762 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:35.668605 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:35.669174 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:35.905893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:35.914366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a8b7247f-cb7c-4a4d-a196-5d4ceb226f13 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1681 microversion: 2.1 time: 0.259259 Jun 15 11:02:35.915121 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2090/4291] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:35 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:02:36.673380 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-decc2b06-c55c-4740-bfe1-c216a9075f59 req-c1da12cc-d255-4aa1-9bc3-6efab75f4809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3187defd-f82b-4298-b55e-eeea8d869423", "name": "network-vif-deleted", "tag": "eb280006-b851-46fd-871d-ac53dd3015b2"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:02:36.682733 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-decc2b06-c55c-4740-bfe1-c216a9075f59 req-c1da12cc-d255-4aa1-9bc3-6efab75f4809 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:36.683134 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-decc2b06-c55c-4740-bfe1-c216a9075f59 req-c1da12cc-d255-4aa1-9bc3-6efab75f4809 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:36.694571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-decc2b06-c55c-4740-bfe1-c216a9075f59 req-c1da12cc-d255-4aa1-9bc3-6efab75f4809 service nova] Creating event network-vif-deleted:eb280006-b851-46fd-871d-ac53dd3015b2 for instance 3187defd-f82b-4298-b55e-eeea8d869423 on hv-cinder-84580 Jun 15 11:02:36.700391 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-decc2b06-c55c-4740-bfe1-c216a9075f59 req-c1da12cc-d255-4aa1-9bc3-6efab75f4809 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031620 Jun 15 11:02:36.701023 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2202/4292] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:02:37.164495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:37.165334 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:37.172709 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:37.173478 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:37.174150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:37.174694 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:37.211615 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:37.212169 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:37.212703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lazy-loading 'fault' on Instance uuid 3187defd-f82b-4298-b55e-eeea8d869423 {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:02:37.262992 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4beff9397579496c80fd6e93b7a81542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce59d9a516c4ec296e5f4e74627491b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:02:37.271741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-767ab112-e962-4e33-91f6-01b39e29e585 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 200 len: 1329 microversion: 2.1 time: 0.343464 Jun 15 11:02:37.272687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2091/4293] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:36 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 1329 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:02:38.291357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:38.292058 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:38.299392 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:38.299833 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:38.300601 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:38.301065 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:38.317640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 HTTP/1.1 Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:38.320828 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:38.322191 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '3187defd-f82b-4298-b55e-eeea8d869423'} Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:38.322939 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:38.324244 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:38.326629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:38.326629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-60f38bc2-7696-4f5a-bd05-c794efb16281 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 404 len: 111 microversion: 2.1 time: 0.033576 Jun 15 11:02:38.326629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2203/4294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:38 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:38.331203 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6bec905b-a609-44d0-863b-5ffacfdca1f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '.version_select at 0x7fc27dcec670>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:38.449292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6bec905b-a609-44d0-863b-5ffacfdca1f6 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143287617" status: 202 len: 0 microversion: 2.1 time: 0.121984 Jun 15 11:02:38.449948 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2092/4295] 10.222.0.60 () {58 vars in 1220 bytes} [Wed Jun 15 11:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143287617 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:02:45.836764 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:45.837351 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:45.844435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:45.845028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:45.845768 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:45.846213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:45.861357 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 HTTP/1.1 Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:45.863002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.871122 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '3187defd-f82b-4298-b55e-eeea8d869423'} Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:45.871738 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.872884 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.873976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:45.873976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30897507-e9d3-409e-bd03-51f60528ee43 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 404 len: 111 microversion: 2.1 time: 0.031838 Jun 15 11:02:45.873976 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2204/4296] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:45 2022] DELETE /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:45.874150 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:45.874547 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: 3187defd-f82b-4298-b55e-eeea8d869423] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:45.880749 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:45.881344 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:45.882264 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:45.882699 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:45.897665 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 HTTP/1.1 Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:45.899580 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.902998 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': '3187defd-f82b-4298-b55e-eeea8d869423'} Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:45.904375 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. Jun 15 11:02:45.905333 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:45.906294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance 3187defd-f82b-4298-b55e-eeea8d869423 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:45.906294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ac25e258-1021-433d-849d-795f46477041 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423" status: 404 len: 111 microversion: 2.1 time: 0.031791 Jun 15 11:02:45.906294 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2093/4297] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:45 2022] GET /compute/v2.1/servers/3187defd-f82b-4298-b55e-eeea8d869423 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:47.181517 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:47.182118 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:47.189725 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.190173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.190951 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.191384 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.207098 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 HTTP/1.1 Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:47.208664 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.216988 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': 'f4151473-56b5-415e-b577-98d34aa05543'} Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:47.217689 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.218799 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.219938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:47.219938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f70720cf-1e2d-4c78-8d35-f8e2bba99f85 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 404 len: 111 microversion: 2.1 time: 0.032858 Jun 15 11:02:47.219938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2205/4298] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:47 2022] DELETE /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:47.223098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:47.223710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: f4151473-56b5-415e-b577-98d34aa05543] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:47.230991 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.231633 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.232652 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.233313 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.237094 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:47.250207 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 HTTP/1.1 Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:47.251751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.252951 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'f4151473-56b5-415e-b577-98d34aa05543'} Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:47.253614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. Jun 15 11:02:47.254569 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.255421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance f4151473-56b5-415e-b577-98d34aa05543 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:47.255421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-54131523-bfb7-4092-891a-108d1f9902fd tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543" status: 404 len: 111 microversion: 2.1 time: 0.033932 Jun 15 11:02:47.255421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2094/4299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:47 2022] GET /compute/v2.1/servers/f4151473-56b5-415e-b577-98d34aa05543 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:47.262040 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:47.262561 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:47.269777 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.270227 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.270996 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.271432 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.286018 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 HTTP/1.1 Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:47.287598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.288791 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': 'cb2f5859-7f7e-4ff6-9489-cf042c8dfe93'} Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:47.289463 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.290829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.292034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:47.292034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-14dc1c2b-e38c-4fb4-98ad-290109ea3b9a tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 404 len: 111 microversion: 2.1 time: 0.030875 Jun 15 11:02:47.292034 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2206/4300] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:47 2022] DELETE /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 11:02:47.298557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:47.299163 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: cb2f5859-7f7e-4ff6-9489-cf042c8dfe93] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:47.305490 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.305985 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.307543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:47.307543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:47.324023 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 HTTP/1.1 Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:47.327069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.332170 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'cb2f5859-7f7e-4ff6-9489-cf042c8dfe93'} Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:47.332893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. Jun 15 11:02:47.334125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:47.335201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:47.335201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5dec950c-7daa-4ba8-a015-1db12aa492ad tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93" status: 404 len: 111 microversion: 2.1 time: 0.034659 Jun 15 11:02:47.335201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2095/4301] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:47 2022] GET /compute/v2.1/servers/cb2f5859-7f7e-4ff6-9489-cf042c8dfe93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:48.669704 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:48.670237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:48.677024 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:48.677472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:48.678228 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:48.678659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:48.693439 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 HTTP/1.1 Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:02:48.694984 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.696283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': 'c4944d55-b710-413e-81ed-24e682fa5479'} Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:48.697476 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.698637 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.699770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:48.699770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-48779234-d903-44ea-b9f7-70d937735e19 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 404 len: 111 microversion: 2.1 time: 0.030797 Jun 15 11:02:48.699770 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2207/4302] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:02:48 2022] DELETE /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:02:48.705953 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:02:48.706579 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] [instance: c4944d55-b710-413e-81ed-24e682fa5479] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:02:48.709538 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:02:48.714779 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:48.715216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:48.715976 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:02:48.716647 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:02:48.730292 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] HTTP exception thrown: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Request method failure captured: Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 HTTP/1.1 Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbLFA71vWvloQLyVjHncT3iqt9f4A8mBx1tEhrCV3fCPshVxdgBg0TJpiZUe8-WIxB_Ab6fxkofXC7j3LUOz9EoYRBM0hAwMbXVG8NAxM_cHs4IY5_4aTK2dBbOSpUO_DB4wMVcCNjcHfBgUfuEEOwx_y98igBkr1-Sro--ODmrrGDY Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:02:48.732399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3ce59d9a516c4ec296e5f4e74627491b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3ce59d9a516c4ec296e5f4e74627491b", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 3ce59d9a516c4ec296e5f4e74627491b Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-102733969 Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 4beff9397579496c80fd6e93b7a81542 Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-AttachVolumeNegativeTest-102733969-project Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.738276 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'id': 'c4944d55-b710-413e-81ed-24e682fa5479'} Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:02:48.739046 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. Jun 15 11:02:48.740659 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:02:48.741797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] Returning 404 to user: Instance c4944d55-b710-413e-81ed-24e682fa5479 could not be found. {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:02:48.741797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7666eabe-9c00-45d9-937e-a678b674fdc9 tempest-AttachVolumeNegativeTest-102733969 tempest-AttachVolumeNegativeTest-102733969-project] 10.222.0.60 "GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479" status: 404 len: 111 microversion: 2.1 time: 0.031842 Jun 15 11:02:48.741797 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2096/4303] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:02:48 2022] GET /compute/v2.1/servers/c4944d55-b710-413e-81ed-24e682fa5479 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:05:09.713780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:05:09.714295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:05:16.352441 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dbdd0dc5-4ed4-45de-a3e7-b72363fad042] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 15 11:05:16.353213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:16.353972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:16.357890 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'create', calling method: .version_select at 0x7fc27df2ca60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-818951376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/IKSa/haVcj7/W+gBfbincKqHINDkLuntq5l8ntPLZMOve4q6Ixk4GdLbf2eDmvbjQYrC6N7d+8p/nvo0202YNpDlwMTmdP9Dkm0tguBAl2QYcGLO5cGZnTUGaoPY8hg=="}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:05:16.372757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Getting quotas for project 4364ff6415314f4d83fc80f29c6efe1c. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 11:05:16.376600 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.quota [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Getting quotas for user 5e4462db728a41528492919a6787c8df and project 4364ff6415314f4d83fc80f29c6efe1c. Resources: {'key_pairs'} {{(pid=118121) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 11:05:16.388268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [7fab87bc-675c-456f-8a13-7b61f5aee5e3] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 11:05:17.359809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] [dbdd0dc5-4ed4-45de-a3e7-b72363fad042] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43972. Jun 15 11:05:17.394377 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [7fab87bc-675c-456f-8a13-7b61f5aee5e3] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43974. Jun 15 11:05:17.488938 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-8470561d-c8bd-465a-8ff6-ece25e5ac74b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.137803 Jun 15 11:05:17.489816 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2208/4304] 10.222.0.60 () {60 vars in 1158 bytes} [Wed Jun 15 11:05:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:05:17.540710 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [-] [45b3b82a-bb03-4c28-8511-be0a309e6c14] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 15 11:05:17.544796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-179392752", "imageRef": "2e7128dc-5e9c-4d6d-bf8c-22e57332508b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-818951376", "networks": [{"uuid": "c8cd1889-647a-447f-a75a-d7a15abeae62"}]}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:05:17.724445 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.network.neutron [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] validate_networks() for [('c8cd1889-647a-447f-a75a-d7a15abeae62', None, None, None, None, None)] {{(pid=118120) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 11:05:18.196791 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Flavor limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 11:05:18.197246 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Image limits 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 11:05:18.197728 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Flavor pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 11:05:18.198142 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Image pref 0:0:0 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 11:05:18.198556 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.virt.hardware [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118120) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 11:05:18.208408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:18.208863 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:18.209692 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:18.210130 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:18.226975 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Getting quotas for project 4364ff6415314f4d83fc80f29c6efe1c. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 11:05:18.231040 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.quota [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Getting quotas for user 5e4462db728a41528492919a6787c8df and project 4364ff6415314f4d83fc80f29c6efe1c. Resources: {'cores', 'instances', 'ram'} {{(pid=118120) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 11:05:18.242564 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Going to run 1 instances... {{(pid=118120) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 11:05:18.244796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2e7128dc-5e9c-4d6d-bf8c-22e57332508b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118120) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 11:05:18.440054 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [c445f912-becb-4955-9760-14dc47fb9267] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 11:05:18.547242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] [45b3b82a-bb03-4c28-8511-be0a309e6c14] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43994. Jun 15 11:05:19.446864 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [c445f912-becb-4955-9760-14dc47fb9267] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 43996. Jun 15 11:05:19.454800 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c66a65a8-caf9-4e8d-a8cf-b986dfda278e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917068 Jun 15 11:05:19.455443 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2097/4305] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Jun 15 11:05:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 11:05:19.467150 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f6fc6bac-6cc6-4fba-8008-9e7a57964015 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:19.467810 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f6fc6bac-6cc6-4fba-8008-9e7a57964015 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:19.581376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f6fc6bac-6cc6-4fba-8008-9e7a57964015 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:19.589213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f6fc6bac-6cc6-4fba-8008-9e7a57964015 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1257 microversion: 2.1 time: 0.126427 Jun 15 11:05:19.589780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2209/4306] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:19 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1257 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:20.606618 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-956309c7-f115-46a9-be75-1bee87ee24c3 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:20.607235 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-956309c7-f115-46a9-be75-1bee87ee24c3 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:20.663001 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-956309c7-f115-46a9-be75-1bee87ee24c3 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:20.669759 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-956309c7-f115-46a9-be75-1bee87ee24c3 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1257 microversion: 2.1 time: 0.067485 Jun 15 11:05:20.670329 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2098/4307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:20 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:21.689183 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c0097034-0af3-4cc7-ba17-58479c6fd3ac tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:21.690177 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c0097034-0af3-4cc7-ba17-58479c6fd3ac tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:21.762950 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c0097034-0af3-4cc7-ba17-58479c6fd3ac tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:21.770568 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c0097034-0af3-4cc7-ba17-58479c6fd3ac tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1257 microversion: 2.1 time: 0.086344 Jun 15 11:05:21.771366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2210/4308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:21 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1257 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:22.789045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ce9c161c-f6d9-4de9-9246-3c30ed1f95e0 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:22.789678 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ce9c161c-f6d9-4de9-9246-3c30ed1f95e0 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:22.849224 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ce9c161c-f6d9-4de9-9246-3c30ed1f95e0 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:22.856133 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ce9c161c-f6d9-4de9-9246-3c30ed1f95e0 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1257 microversion: 2.1 time: 0.072084 Jun 15 11:05:22.856707 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2099/4309] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:22 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:23.874472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:23.875068 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:23.882954 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:23.883398 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:23.884234 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:23.884675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:23.950283 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:23.958200 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-114f5de6-ac97-44f7-8907-a8e982f278fd tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1261 microversion: 2.1 time: 0.087512 Jun 15 11:05:23.958779 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2211/4310] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:23 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:24.976060 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:24.976675 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:24.983875 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:24.984322 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:24.985113 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:24.985550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:25.046248 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:25.053969 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-609e0103-d35d-4db1-99d9-e4ca7c0e5e4a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1261 microversion: 2.1 time: 0.082537 Jun 15 11:05:25.055012 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2100/4311] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:24 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:26.071566 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:26.072124 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:26.079209 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:26.079650 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:26.080438 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:26.080871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:26.147084 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:26.154889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-837d39a1-2636-4a23-97e5-2b9d18c3702d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1317 microversion: 2.1 time: 0.087238 Jun 15 11:05:26.159241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2212/4312] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:26 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1317 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:27.173175 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:27.174381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:27.187050 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:27.187840 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:27.189190 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:27.189844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:27.354661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:27.362308 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-112bad5e-4c91-44aa-8328-d4084dfd7397 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.193460 Jun 15 11:05:27.362881 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2101/4313] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:27 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:28.380368 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:28.380994 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:28.387153 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:28.387595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:28.388416 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:28.388847 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:28.531598 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:28.540872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-78327550-de7d-4ec6-8fe7-63de16ac8ed9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.164799 Jun 15 11:05:28.541729 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2213/4314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:28 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:05:29.558902 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:29.560395 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:29.566785 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:29.568703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:29.569236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:29.570077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:29.570667 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:29.714068 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:29.722874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-44b287df-d418-492a-9cd9-daafed54e825 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.168373 Jun 15 11:05:29.723943 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2102/4315] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:29 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:30.740571 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:30.741319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:30.748089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:30.748526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:30.749379 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:30.749751 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:30.888928 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:30.898470 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-d84b0294-6ada-47a0-8101-5d25848539b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.162344 Jun 15 11:05:30.899059 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2214/4316] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:30 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 11:05:31.916363 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:31.916995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:31.925354 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:31.926434 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:31.927735 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:31.928321 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:32.069751 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:32.077399 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a8785aff-b668-4ac9-80a6-473709b04c7a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.165149 Jun 15 11:05:32.078691 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2103/4317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:31 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:32.180090 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:05:32.180663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:05:33.095713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:33.096647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:33.100714 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell0:SELECT=8 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:33.105308 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:33.105886 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:33.106678 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:33.107112 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:33.285577 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:33.295257 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f3b634ca-da33-4ce5-aefe-863aa04cd3d5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.203623 Jun 15 11:05:33.295960 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2215/4318] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:33 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:34.314093 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:34.314661 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:34.317162 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=10 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:34.322708 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:34.323156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:34.323921 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:34.324367 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:34.459092 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:34.466501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-97a5c58b-2666-4914-a29c-b84d678a6104 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.156310 Jun 15 11:05:34.467061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2104/4319] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:34 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:35.483611 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:35.484243 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:35.491820 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:35.492268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:35.493057 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:35.493494 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:35.624048 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:35.632338 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2f6e30b2-08c5-4d97-ab80-4c7f38bd9a84 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.152505 Jun 15 11:05:35.632889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2216/4320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:35 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:36.649403 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:36.649971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:36.656566 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:36.657037 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:36.657857 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:36.658289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:36.793337 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:36.800858 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-72c4a386-4b56-483d-8325-24ec1e0b977c tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.155612 Jun 15 11:05:36.801447 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2105/4321] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:36 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:37.817626 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:37.818235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:37.825343 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:37.825785 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:37.826541 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:37.826975 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:37.957957 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:37.965472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4432b65-cdbb-417c-9a8c-0df094249cc9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.151628 Jun 15 11:05:37.966038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2217/4322] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:37 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:38.983201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:38.983817 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:38.991720 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:38.991924 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:38.992944 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:38.993416 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:39.136381 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:39.143995 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-aff57358-2acb-49a5-98ea-ed7896669374 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.164898 Jun 15 11:05:39.144553 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2106/4323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:38 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:40.161435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:40.161966 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:40.169312 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:40.169789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:40.170581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:40.171012 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:40.304509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:40.312238 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c37fdf9-2ba3-4a2e-aa70-ba9cb28de79d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.154676 Jun 15 11:05:40.312809 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2218/4324] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:40 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:41.329306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:41.330027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:41.336917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:41.337373 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:41.338168 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:41.338596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:41.466045 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:41.473673 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-05fca1e2-f61f-430d-9e8e-e0a13bd156ee tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.148211 Jun 15 11:05:41.479418 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2107/4325] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:41 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:42.491686 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:42.493310 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:42.499817 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:42.500255 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:42.501021 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:42.501453 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:42.632133 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:42.640663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-62fe01bf-dca1-4ba3-9e8a-c3e8332cd850 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.153022 Jun 15 11:05:42.641266 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2219/4326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:42 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:43.657837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:43.659242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:43.667128 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:43.667648 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:43.668558 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:43.668922 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:43.770756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-8962ffe6-b2fe-462d-bea3-71cb58d44d95 req-08623c7d-6cf3-42ce-bab1-0524049db071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:05:43.779089 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8962ffe6-b2fe-462d-bea3-71cb58d44d95 req-08623c7d-6cf3-42ce-bab1-0524049db071 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:43.779789 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-8962ffe6-b2fe-462d-bea3-71cb58d44d95 req-08623c7d-6cf3-42ce-bab1-0524049db071 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:43.800319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-8962ffe6-b2fe-462d-bea3-71cb58d44d95 req-08623c7d-6cf3-42ce-bab1-0524049db071 service nova] Creating event network-changed:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:05:43.807707 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-8962ffe6-b2fe-462d-bea3-71cb58d44d95 req-08623c7d-6cf3-42ce-bab1-0524049db071 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122490 Jun 15 11:05:43.808912 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2220/4327] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:05:43.858282 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:43.867649 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-550d7fef-3d03-4fe9-b72f-5e9bc670c1e8 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.213021 Jun 15 11:05:43.867892 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2108/4328] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:43 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:44.884822 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:44.885559 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:44.892173 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:44.892623 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:44.893436 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:44.894157 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:45.029660 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:45.041703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-9d2fa059-9a1f-43ee-a2fe-f21ab93c229f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.161695 Jun 15 11:05:45.042246 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2221/4329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:44 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:46.060407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:46.061185 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:46.068014 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:46.068398 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:46.069195 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:46.069731 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:46.203798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:46.212154 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-c7d958c4-4b67-4329-9d4e-3b3558cdd31a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.155583 Jun 15 11:05:46.212733 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2109/4330] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:46 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:47.229430 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:47.230038 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:47.232487 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:47.237992 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:47.238449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:47.239217 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:47.239652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:47.242769 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=63 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:47.380015 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:47.388340 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-30994b49-4f44-4f79-81ab-57c5bc307715 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.163447 Jun 15 11:05:47.389111 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2222/4331] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:47 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:48.405494 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:48.406100 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:48.408457 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:48.413412 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:48.414300 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:48.414607 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:48.415041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:48.417626 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=68 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:05:48.549643 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:48.558234 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-597662f3-8845-41e5-911c-820a3f34181d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.156842 Jun 15 11:05:48.558798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2110/4332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:48 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:49.575760 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:49.576291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:49.583363 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:49.583808 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:49.584578 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:49.585027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:49.713187 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:49.720593 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5c9f2f47-0825-4fd3-8c09-82b18dbbf586 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.148763 Jun 15 11:05:49.721188 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2223/4333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:49 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:50.738364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:50.738973 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:50.746783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:50.747241 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:50.748016 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:50.748454 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:50.888114 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:50.895845 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6795c23e-97ce-40ab-bfb5-9a225e077822 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.161515 Jun 15 11:05:50.896408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2111/4334] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:50 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:51.913376 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:51.914087 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:51.920813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:51.921290 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:51.922092 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:51.922526 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:52.055874 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:52.063435 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-0b84363b-8d2a-4743-8591-853818f5408d tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.153901 Jun 15 11:05:52.064008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2224/4335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:51 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:52.261573 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-e1232df3-0525-4b12-bc13-034f3333d25e req-29650309-00f7-4b81-8655-bc158490abdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "name": "network-vif-plugged", "status": "completed", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:05:52.270103 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e1232df3-0525-4b12-bc13-034f3333d25e req-29650309-00f7-4b81-8655-bc158490abdb service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:52.270544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-e1232df3-0525-4b12-bc13-034f3333d25e req-29650309-00f7-4b81-8655-bc158490abdb service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:52.282135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-e1232df3-0525-4b12-bc13-034f3333d25e req-29650309-00f7-4b81-8655-bc158490abdb service nova] Creating event network-vif-plugged:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:05:52.287365 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-e1232df3-0525-4b12-bc13-034f3333d25e req-29650309-00f7-4b81-8655-bc158490abdb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122745 Jun 15 11:05:52.287955 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2112/4336] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:05:53.082138 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:53.082749 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:53.089963 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:53.090403 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:53.091162 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:53.091646 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:53.224170 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:53.231829 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-2fa8b054-3c0f-4c8d-a516-b166defe2010 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1357 microversion: 2.1 time: 0.153587 Jun 15 11:05:53.232369 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2225/4337] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:53 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:54.251027 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:54.251726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:54.258052 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.258495 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.259253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.259696 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.398837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:54.410197 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-cf8646bd-1324-45e2-9db3-f2d548def0e5 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1546 microversion: 2.1 time: 0.163698 Jun 15 11:05:54.412269 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2113/4338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:54 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:54.428442 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:54.429099 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:54.437105 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.437564 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.438370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.438826 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.586464 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:54.595929 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-7928b119-718c-477b-ab4e-957bef5fc600 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1546 microversion: 2.1 time: 0.172451 Jun 15 11:05:54.596399 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2226/4339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:54 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:54.613135 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:54.616764 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:54.617557 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Searching by: {'deleted': False, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c'} {{(pid=118120) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 11:05:54.624380 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.624828 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.625653 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.626098 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.720748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.multi_cell_list [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118120) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 11:05:54.817468 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7d90b1c1-eddb-4621-b7f3-0d9a8d52ea44 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208159 Jun 15 11:05:54.817977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2114/4340] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Jun 15 11:05:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:05:54.828659 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:05:54.829303 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:54.835629 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.836073 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.836851 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:54.837317 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:54.971889 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:05:54.980256 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-c18fd9be-b2a0-4330-901f-0a0efdc0117f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1546 microversion: 2.1 time: 0.155358 Jun 15 11:05:54.980818 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2227/4341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:05:54 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:05:56.893897 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "490e1484-6170-4173-a4b3-a9fb5c93e261"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:05:56.894952 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:05:56.901767 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:56.902216 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:56.903798 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:05:56.904025 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:05:57.690596 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-1b4005c8-77ac-4bd4-bd4a-ed7d9c84f93a tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800432 Jun 15 11:05:57.691223 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2115/4342] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Jun 15 11:05:56 2022] POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:06:06.298251 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:06:06.298844 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:06:06.301355 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=11 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:06:06.302020 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=35 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:06:06.306782 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:06.307222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:06.307978 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:06.308408 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:06.442332 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:06:06.450210 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-6e705b33-fed2-4d27-a56f-d5b96692acbe tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1592 microversion: 2.1 time: 0.155801 Jun 15 11:06:06.450780 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2228/4343] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:06:06 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1592 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:06:08.409253 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell0:SELECT=2 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:06:08.410531 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=11 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:06:08.411366 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:06:08.468748 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [req-0dfd255d-57c0-4225-8a70-a531b94da183 req-a8857d51-a977-47fb-9714-fb852c7e014b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:06:08.477325 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0dfd255d-57c0-4225-8a70-a531b94da183 req-a8857d51-a977-47fb-9714-fb852c7e014b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:08.478355 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [req-0dfd255d-57c0-4225-8a70-a531b94da183 req-a8857d51-a977-47fb-9714-fb852c7e014b service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:08.489450 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.compute.server_external_events [req-0dfd255d-57c0-4225-8a70-a531b94da183 req-a8857d51-a977-47fb-9714-fb852c7e014b service nova] Creating event network-changed:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:06:08.494662 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [req-0dfd255d-57c0-4225-8a70-a531b94da183 req-a8857d51-a977-47fb-9714-fb852c7e014b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091700 Jun 15 11:06:08.495498 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2116/4344] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:06:10.982972 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1678550662"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:06:10.983522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:06:10.990525 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:10.990973 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:10.992009 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:10.992536 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:11.122472 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.network.security_group_api [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Adding security group 97ae8d22-4553-480c-8308-36e014e4e4c1 to port 53a652c5-a778-4cdd-aac6-f1f567bb0e7d Jun 15 11:06:11.542193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-dce3f3d2-ec35-4fee-8b16-97bf31866510 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action" status: 202 len: 0 microversion: 2.1 time: 0.558423 Jun 15 11:06:11.542193 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2229/4345] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 11:06:10 2022] POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:06:11.551926 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-61df1d52-1dc7-4bf0-a596-566f302807cf req-d11747b8-dfda-4933-b4dd-c189df3a5d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:06:11.557138 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:06:11.559245 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:06:11.576822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:11.576822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:11.576822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:11.576822 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:11.577922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-61df1d52-1dc7-4bf0-a596-566f302807cf req-d11747b8-dfda-4933-b4dd-c189df3a5d98 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:06:11.578647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-61df1d52-1dc7-4bf0-a596-566f302807cf req-d11747b8-dfda-4933-b4dd-c189df3a5d98 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:06:11.597899 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-61df1d52-1dc7-4bf0-a596-566f302807cf req-d11747b8-dfda-4933-b4dd-c189df3a5d98 service nova] Creating event network-changed:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:06:11.606299 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-61df1d52-1dc7-4bf0-a596-566f302807cf req-d11747b8-dfda-4933-b4dd-c189df3a5d98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056674 Jun 15 11:06:11.606449 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2230/4346] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:06:11.854703 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:06:11.863697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-6fc7c0a8-0805-4dd0-96c0-15f34b037ef9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1758 microversion: 2.1 time: 0.320678 Jun 15 11:06:11.864814 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2117/4347] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:06:11 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1758 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:09.557116 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=6 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:07:09.557922 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=12 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:07:09.562029 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:07:09.563222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:09.569743 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:09.570213 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:09.571032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:09.571469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:09.781562 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-bb2fae59-3cda-4708-a179-8b12530db924 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action" status: 202 len: 0 microversion: 2.1 time: 0.225813 Jun 15 11:07:09.783109 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2231/4348] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 11:07:09 2022] POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:07:09.790214 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:09.790893 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:09.793002 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=4 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:07:09.793655 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=8 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:07:09.798540 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:09.798978 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:09.799742 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:09.800165 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:09.945041 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:09.953987 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f86c5c61-3061-4d8d-af03-e1f349b8b0f4 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1750 microversion: 2.1 time: 0.166779 Jun 15 11:07:09.954796 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2118/4349] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:09 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:10.972197 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:10.972900 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:10.979222 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:10.979663 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:10.980424 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:10.980853 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:11.129362 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:11.137619 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-5ed9f96f-b111-42bb-a28f-0b415901e513 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.170769 Jun 15 11:07:11.138185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2232/4350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:10 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:12.155634 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:12.156196 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:12.162862 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:12.163302 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:12.164051 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:12.164479 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:12.313061 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:12.321284 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ba50405c-e05c-43aa-807b-bd1dfd306068 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.169512 Jun 15 11:07:12.321854 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2119/4351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:12 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:13.338537 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:13.339281 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:13.347223 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:13.347730 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:13.348482 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:13.348910 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:13.493625 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:13.502675 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-beeb87be-d377-411d-8c6d-0d7ce121cdd9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.168077 Jun 15 11:07:13.503233 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2233/4352] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:13 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:14.519926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:14.520541 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:14.527499 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:14.527950 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:14.528775 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:14.529364 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:14.676670 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:14.684717 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-9952878b-4cd3-4beb-b8ed-e4de160e8123 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.168956 Jun 15 11:07:14.685306 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2120/4353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:14 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:15.702887 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:15.703509 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:15.710588 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:15.711032 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:15.711825 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:15.712258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:15.867961 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:15.876640 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-cb1c1ee2-c32c-4e70-a9be-8e428ec6701f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.177626 Jun 15 11:07:15.877258 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2234/4354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:15 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:16.895217 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:16.895763 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:16.902220 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:16.902658 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:16.903410 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:16.903837 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:17.056685 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:17.065668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-a77c384c-9c0a-48b4-98b7-84d1aa982711 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.175235 Jun 15 11:07:17.066229 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2121/4355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:16 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:18.082999 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:18.083605 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:18.089793 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:18.090241 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:18.091008 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:18.091446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:18.241319 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:18.249872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-def3a8ee-1253-4a40-bbe1-af9b301ff3c7 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.170889 Jun 15 11:07:18.251082 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2235/4356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:18 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:19.267528 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:19.268236 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:19.274301 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:19.274741 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:19.275504 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:19.275926 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:19.437972 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:19.447155 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-089023ab-5ca6-42cf-85ad-6469bb5948a1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.184210 Jun 15 11:07:19.456713 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2122/4357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:19 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:20.463861 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:20.464469 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:20.471857 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:20.472295 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:20.473086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:20.473576 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:20.625964 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:20.634074 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-17aa8ee3-d88f-44c3-b046-c8a547839998 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.174303 Jun 15 11:07:20.634639 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2236/4358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:20 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:21.652506 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:21.653173 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:21.659963 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:21.660407 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:21.661210 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:21.661646 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:21.809530 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:21.818279 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-74f85545-4559-4bd2-bec4-bc4136a2ef14 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.169502 Jun 15 11:07:21.818850 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2123/4359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:21 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:22.836028 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:22.836581 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:22.846708 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:22.847148 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:22.847917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:22.848347 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:22.994370 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:23.003164 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-3acd105c-1aad-448e-a1d8-462c0a1bf3ec tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.170972 Jun 15 11:07:23.003756 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2237/4360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:22 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:24.021134 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:24.021745 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:24.028315 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:24.028761 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:24.029559 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:24.029994 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:24.178941 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:24.187156 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-ebdb6fac-1ecd-4238-9bcd-649aeb523643 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.170776 Jun 15 11:07:24.187726 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2124/4361] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:24 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:25.204274 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:25.205027 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:25.211872 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:25.212315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:25.213189 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:25.213622 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:25.359030 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:25.367911 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-023886d1-6657-4aa7-8d7c-9a8a11c4ee4f tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.167754 Jun 15 11:07:25.368758 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2238/4362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:25 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:26.385252 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:26.385874 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:26.392529 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:26.392997 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:26.393777 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:26.394209 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:26.544089 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:26.553359 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-2443b0e7-55ef-4289-9dfd-6f64a912c088 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1755 microversion: 2.1 time: 0.171460 Jun 15 11:07:26.553671 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2125/4363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:26 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:27.570757 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:07:27.571431 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:07:27.577883 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:27.578318 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:27.579315 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:07:27.579778 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:07:27.724620 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:07:27.732688 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-b1d81ef9-399a-49d2-8ae8-04915f03fa91 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1758 microversion: 2.1 time: 0.165766 Jun 15 11:07:27.733296 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2239/4364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:07:27 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:07:50.823687 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:07:50.824249 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:08:29.725500 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:08:29.726114 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:08:31.053028 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_api:SELECT=16 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:08:31.053783 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG dbcounter [-] [118120] Writing DB stats nova_cell1:SELECT=48 {{(pid=118120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:08:31.057732 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1678550662"}} {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:08:31.058262 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:31.064146 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:31.068536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:31.068536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:31.068536 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:31.196069 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.network.security_group_api [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Removing security group 97ae8d22-4553-480c-8308-36e014e4e4c1 from port 53a652c5-a778-4cdd-aac6-f1f567bb0e7d Jun 15 11:08:31.583422 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-5c92672d-ab30-45f8-95f1-17eb20c0b935 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action" status: 202 len: 0 microversion: 2.1 time: 0.532005 Jun 15 11:08:31.585788 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2126/4365] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Jun 15 11:08:31 2022] POST /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:08:31.604550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-93f91e11-8701-4225-9c28-fd555ed65d9a req-320639ad-6a73-4b65-96b0-f4e6489831d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:08:31.615917 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_api:SELECT=18 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:08:31.617539 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG dbcounter [-] [118121] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118121) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 11:08:31.620440 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-93f91e11-8701-4225-9c28-fd555ed65d9a req-320639ad-6a73-4b65-96b0-f4e6489831d0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:31.621100 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-93f91e11-8701-4225-9c28-fd555ed65d9a req-320639ad-6a73-4b65-96b0-f4e6489831d0 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:31.640203 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-93f91e11-8701-4225-9c28-fd555ed65d9a req-320639ad-6a73-4b65-96b0-f4e6489831d0 service nova] Creating event network-changed:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:08:31.646104 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-93f91e11-8701-4225-9c28-fd555ed65d9a req-320639ad-6a73-4b65-96b0-f4e6489831d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053055 Jun 15 11:08:31.649037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2240/4366] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:08:33.369421 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:33.369977 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:33.377242 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:33.377697 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:33.378501 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:33.378942 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:33.466550 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lazy-loading 'services' on Instance uuid 9c97cd11-ef4a-4707-a7b5-7694597c890a {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:08:33.665075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-9a0763d5-0054-4938-860e-efb12cb5b644 req-e6f16cc1-c45b-4380-b642-e450cffcafc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:08:33.668871 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [a7385e94-f15b-4a37-ad12-e1c8b557e7e3] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 11:08:33.676790 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-9a0763d5-0054-4938-860e-efb12cb5b644 req-e6f16cc1-c45b-4380-b642-e450cffcafc9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:33.677383 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-9a0763d5-0054-4938-860e-efb12cb5b644 req-e6f16cc1-c45b-4380-b642-e450cffcafc9 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:33.689093 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-9a0763d5-0054-4938-860e-efb12cb5b644 req-e6f16cc1-c45b-4380-b642-e450cffcafc9 service nova] Creating event network-changed:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:08:33.693998 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-9a0763d5-0054-4938-860e-efb12cb5b644 req-e6f16cc1-c45b-4380-b642-e450cffcafc9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032881 Jun 15 11:08:33.694784 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2241/4367] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 11:08:34.676614 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [a7385e94-f15b-4a37-ad12-e1c8b557e7e3] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44306. Jun 15 11:08:34.679876 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-50de27ed-b99a-4cc2-8e4e-4260786de2b6 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments/490e1484-6170-4173-a4b3-a9fb5c93e261" status: 202 len: 0 microversion: 2.1 time: 1.314566 Jun 15 11:08:34.680472 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2127/4368] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 11:08:33 2022] DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments/490e1484-6170-4173-a4b3-a9fb5c93e261 => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:08:34.690237 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:34.691235 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:34.698002 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:34.698446 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:34.699195 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:34.699671 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:34.730748 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-a57a7c41-5836-4e80-b757-400bc18d9acc tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Jun 15 11:08:34.732556 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2242/4369] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:08:34 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:08:35.745889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:35.747110 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:35.754328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:35.754328 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:35.754971 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:35.755408 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:35.788044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-20c2e821-5cbd-4537-83a7-6f462527e3db tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Jun 15 11:08:35.788611 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2128/4370] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:08:35 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:08:36.800550 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:36.801407 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:36.808141 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:36.808595 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:36.809373 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:36.809805 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:36.837855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-af7e25eb-9d0d-4141-b0f1-9eb9af1e74b1 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041348 Jun 15 11:08:36.838411 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2243/4371] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Jun 15 11:08:36 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 11:08:36.848879 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:36.849440 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:36.856465 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:36.856990 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:36.858192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:36.858192 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:36.938578 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.wsgi [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] HTTP exception thrown: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a is not attached to volume 490e1484-6170-4173-a4b3-a9fb5c93e261 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Request method failure captured: Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: request: DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments/490e1484-6170-4173-a4b3-a9fb5c93e261 HTTP/1.1 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept: application/json Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Accept-Encoding: identity Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Connection: close Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Length: 0 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Content-Type: application/json Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Host: 10.222.0.60 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Openstack-System-Scope: None Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: User-Agent: python-urllib3/1.26.9 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Auth-Token: gAAAAABiqbzbQGDatFqNdbXhg-C_ls-aI5WQNfFpMYsBSMMHqAa3gj0s6MN9a6ZUBCnim2lGYMTeTYpo-qyacsrAtlMd5Fp2nRySgI0BrXq8l8EhDszdUyKMW2b3f8RXWfy2p0nys7U3ljvkJ9Kb4q7lL0Wt3C2xprqAI9N2FAUqfFSpml21LtA Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Id: None Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Domain-Name: None Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Identity-Status: Confirmed Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Is-Admin-Project: True Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Id: default Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Domain-Name: Default Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Id: 4364ff6415314f4d83fc80f29c6efe1c Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Project-Name: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Role: reader,member Jun 15 11:08:36.940930 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Roles: reader,member Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4364ff6415314f4d83fc80f29c6efe1c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Id: 4364ff6415314f4d83fc80f29c6efe1c Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-Tenant-Name: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User: tempest-TestMinimumBasicScenario-846222689-project Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Id: default Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Domain-Name: Default Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Id: 5e4462db728a41528492919a6787c8df Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: X-User-Name: tempest-TestMinimumBasicScenario-846222689-project Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: method: > Jun 15 11:08:36.942409 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: exception: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a is not attached to volume 490e1484-6170-4173-a4b3-a9fb5c93e261 Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: action_args: {'server_id': '9c97cd11-ef4a-4707-a7b5-7694597c890a', 'id': '490e1484-6170-4173-a4b3-a9fb5c93e261'} Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 490e1484-6170-4173-a4b3-a9fb5c93e261. Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:08:36.943290 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a is not attached to volume 490e1484-6170-4173-a4b3-a9fb5c93e261 Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a is not attached to volume 490e1484-6170-4173-a4b3-a9fb5c93e261 Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: ERROR nova.api.openstack.wsgi Jun 15 11:08:36.944543 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Returning 404 to user: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a is not attached to volume 490e1484-6170-4173-a4b3-a9fb5c93e261 {{(pid=118120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:08:36.945570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-f4534950-3dd5-458d-95b7-f517753f0734 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments/490e1484-6170-4173-a4b3-a9fb5c93e261" status: 404 len: 154 microversion: 2.1 time: 0.097506 Jun 15 11:08:36.945570 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2129/4372] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Jun 15 11:08:36 2022] DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a/os-volume_attachments/490e1484-6170-4173-a4b3-a9fb5c93e261 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:08:38.246703 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:38.247840 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:38.255085 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:38.255528 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:38.256285 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:38.256713 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:38.283540 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Going to try to terminate instance {{(pid=118121) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 11:08:38.623643 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-f4d50000-8a56-477a-95a8-2aa2136fc445 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 204 len: 0 microversion: 2.1 time: 0.380613 Jun 15 11:08:38.624240 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2244/4373] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Jun 15 11:08:38 2022] DELETE /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 11:08:38.632316 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:38.633181 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:38.641844 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:38.642285 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:38.643044 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:38.643481 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:38.775544 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:08:38.783868 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3bca5644-6bf0-42f5-960e-fd97308df958 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1552 microversion: 2.1 time: 0.155303 Jun 15 11:08:38.784435 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2130/4374] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:08:38 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:08:39.801933 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:39.802545 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:39.809075 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:39.809522 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:39.810813 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:39.811278 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:39.944712 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.policy [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118121) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:08:39.953053 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-1be9c0b4-227f-45c4-b68c-6e220b275ec2 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1552 microversion: 2.1 time: 0.155411 Jun 15 11:08:39.953652 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2245/4375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:08:39 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:08:40.970511 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:40.971137 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:40.978201 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:40.978657 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:40.979637 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:40.980077 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:41.149889 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:08:41.158766 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-7113eddb-d31d-479e-978c-1f33f55832b9 tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1552 microversion: 2.1 time: 0.192018 Jun 15 11:08:41.159361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2131/4376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:08:40 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:08:41.257291 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [req-740fa95f-4fbd-4896-b56c-19f12e6b66e4 req-c7819cda-0805-48c1-ba1f-4c05777dbba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c97cd11-ef4a-4707-a7b5-7694597c890a", "name": "network-vif-deleted", "tag": "53a652c5-a778-4cdd-aac6-f1f567bb0e7d"}]} {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 11:08:41.266949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-740fa95f-4fbd-4896-b56c-19f12e6b66e4 req-c7819cda-0805-48c1-ba1f-4c05777dbba2 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:41.267409 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [req-740fa95f-4fbd-4896-b56c-19f12e6b66e4 req-c7819cda-0805-48c1-ba1f-4c05777dbba2 service nova] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:41.279681 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.compute.server_external_events [req-740fa95f-4fbd-4896-b56c-19f12e6b66e4 req-c7819cda-0805-48c1-ba1f-4c05777dbba2 service nova] Creating event network-vif-deleted:53a652c5-a778-4cdd-aac6-f1f567bb0e7d for instance 9c97cd11-ef4a-4707-a7b5-7694597c890a on hv-cinder-84580 Jun 15 11:08:41.284871 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [req-740fa95f-4fbd-4896-b56c-19f12e6b66e4 req-c7819cda-0805-48c1-ba1f-4c05777dbba2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Jun 15 11:08:41.285520 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2246/4377] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Jun 15 11:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 11:08:42.177036 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:42.177594 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.compute.api [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118120) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:42.184289 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:42.185260 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:42.186032 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:42.186462 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:42.222467 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:42.222937 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG oslo_concurrency.lockutils [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:42.223392 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.objects.instance [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lazy-loading 'fault' on Instance uuid 9c97cd11-ef4a-4707-a7b5-7694597c890a {{(pid=118120) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 11:08:42.267539 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.policy [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e4462db728a41528492919a6787c8df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4364ff6415314f4d83fc80f29c6efe1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118120) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 11:08:42.274723 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-e7b6e7f8-ea71-4bb5-ad6d-2f6ebbf7b01e tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 200 len: 1347 microversion: 2.1 time: 0.102881 Jun 15 11:08:42.275346 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2132/4378] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:08:42 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 11:08:43.292885 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '>' {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:43.293647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.compute.api [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] [instance: 9c97cd11-ef4a-4707-a7b5-7694597c890a] Fetching instance by UUID {{(pid=118121) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 11:08:43.300607 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:43.301086 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:43.301855 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 11:08:43.302298 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG oslo_concurrency.lockutils [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Lock "12c8b336-544d-476c-a32e-34dbdfc134b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118121) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 11:08:43.316596 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.wsgi [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] HTTP exception thrown: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Request method failure captured: Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: request: GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a HTTP/1.1 Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept: application/json Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Accept-Encoding: identity Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Connection: close Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Length: 0 Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Content-Type: application/json Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Host: 10.222.0.60 Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Openstack-System-Scope: None Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: User-Agent: python-urllib3/1.26.9 Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Auth-Token: gAAAAABiqbzbQGDatFqNdbXhg-C_ls-aI5WQNfFpMYsBSMMHqAa3gj0s6MN9a6ZUBCnim2lGYMTeTYpo-qyacsrAtlMd5Fp2nRySgI0BrXq8l8EhDszdUyKMW2b3f8RXWfy2p0nys7U3ljvkJ9Kb4q7lL0Wt3C2xprqAI9N2FAUqfFSpml21LtA Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Id: None Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Domain-Name: None Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Identity-Status: Confirmed Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Is-Admin-Project: True Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Id: default Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Domain-Name: Default Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Id: 4364ff6415314f4d83fc80f29c6efe1c Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Project-Name: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Role: reader,member Jun 15 11:08:43.318268 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Roles: reader,member Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4364ff6415314f4d83fc80f29c6efe1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4364ff6415314f4d83fc80f29c6efe1c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Id: 4364ff6415314f4d83fc80f29c6efe1c Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-Tenant-Name: tempest-TestMinimumBasicScenario-846222689 Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User: tempest-TestMinimumBasicScenario-846222689-project Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Id: default Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Domain-Name: Default Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Id: 5e4462db728a41528492919a6787c8df Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: X-User-Name: tempest-TestMinimumBasicScenario-846222689-project Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: method: > Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: exception: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. Jun 15 11:08:43.319479 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: action_args: {'id': '9c97cd11-ef4a-4707-a7b5-7694597c890a'} Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: {{(pid=118121) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 11:08:43.320185 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. Jun 15 11:08:43.321485 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: ERROR nova.api.openstack.wsgi Jun 15 11:08:43.322638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: DEBUG nova.api.openstack.wsgi [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Returning 404 to user: Instance 9c97cd11-ef4a-4707-a7b5-7694597c890a could not be found. {{(pid=118121) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 11:08:43.322638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO nova.api.openstack.requestlog [None req-4403c641-ffdf-47ec-b68c-5617256bc8ce tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a" status: 404 len: 111 microversion: 2.1 time: 0.031682 Jun 15 11:08:43.322638 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: [pid: 118121|app: 0|req: 2247/4379] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Jun 15 11:08:43 2022] GET /compute/v2.1/servers/9c97cd11-ef4a-4707-a7b5-7694597c890a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 11:08:43.328917 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: DEBUG nova.api.openstack.wsgi [None req-3200972e-3669-4a03-90df-55340235597b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] Calling method '.version_select at 0x7fc27911b700>' {{(pid=118120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 11:08:43.424424 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO nova.api.openstack.requestlog [None req-3200972e-3669-4a03-90df-55340235597b tempest-TestMinimumBasicScenario-846222689 tempest-TestMinimumBasicScenario-846222689-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-818951376" status: 202 len: 0 microversion: 2.1 time: 0.099823 Jun 15 11:08:43.428125 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: [pid: 118120|app: 0|req: 2133/4380] 10.222.0.60 () {58 vars in 1268 bytes} [Wed Jun 15 11:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-818951376 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 11:10:19.157326 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:10:19.157949 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:10:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:10:32.176186 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:10:32.176802 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:11:10.832004 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:11:10.832668 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:11:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:11:49.734037 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:11:49.734647 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:11:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:13:39.166410 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:13:39.167120 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:13:52.185847 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:13:52.186451 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:13:52.196800 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:13:52.197366 dv-cinder-845806-2-iscsi devstack@n-api.service[118121]: Wed Jun 15 11:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:14:10.221771 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:14:10.222307 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 11:14:30.841361 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 11:14:30.842022 dv-cinder-845806-2-iscsi devstack@n-api.service[118120]: Wed Jun 15 11:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!